Skip to content

2015

Links for 2015-12-31

Links for 2015-12-22

  • Amazon EC2 Container Registry

    hooray, Docker registry here at last

    ecs docker registry ops containers aws

  • How to inspect SSL/TLS traffic with Wireshark 2

    turns out it's easy enough -- Mozilla standardised a debugging SSL session-key logging file format which Wireshark and Chrome support

    chrome ssl browser firefox wireshark debugging tls

  • ImperialViolet - Juniper: recording some Twitter conversations

    Adam Langley on the Juniper VPN-snooping security hole:

    ... if it wasn't the NSA who did this, we have a case where a US gov­ern­ment back­door ef­fort (Dual-EC) laid the ground­work for some­one else to at­tack US in­ter­ests. Cer­tainly this at­tack would be a lot eas­ier given the pres­ence of a back­door-friendly RNG al­ready in place. And I've not even dis­cussed the SSH back­door. [...]

    primes ecc security juniper holes exploits dual-ec-drbg vpn networking crypto prngs

  • Excellent post from Matthew Green on the Juniper backdoor

    For the past several years, it appears that Juniper NetScreen devices have incorporated a potentially backdoored random number generator, based on the NSA's Dual_EC_DRBG algorithm. At some point in 2012, the NetScreen code was further subverted by some unknown party, so that the very same backdoor could be used to eavesdrop on NetScreen connections. While this alteration was not authorized by Juniper, it's important to note that the attacker made no major code changes to the encryption mechanism -- they only changed parameters. This means that the systems were potentially vulnerable to other parties, even beforehand. Worse, the nature of this vulnerability is particularly insidious and generally messed up. [....] The end result was a period in which someone -- maybe a foreign government -- was able to decrypt Juniper traffic in the U.S. and around the world. And all because Juniper had already paved the road. One of the most serious concerns we raise during [anti-law-enforcement-backdoor] meetings is the possibility that encryption backdoors could be subverted. Specifically, that a back door intended for law enforcement could somehow become a backdoor for people who we don't trust to read our messages. Normally when we talk about this, we're concerned about failures in storage of things like escrow keys. What this Juniper vulnerability illustrates is that the danger is much broader and more serious than that. The problem with cryptographic backdoors is not that they're the only way that an attacker can break intro our cryptographic systems. It's merely that they're one of the best. They take care of the hard work, the laying of plumbing and electrical wiring, so attackers can simply walk in and change the drapes.
    (via Tony Finch)

    via:fanf crypto backdoors politics juniper dual-ec-drbg netscreen vpn

  • 2016 Wish List for AWS?

    good thread of AWS' shortcomings -- so many services still don't handle VPC for instance

    vpc aws ec2 ops wishlist

Links for 2015-12-18

Links for 2015-12-16

Links for 2015-12-15

Links for 2015-12-14

  • Files Are Hard

    This is basically terrifying. A catalog of race conditions and reliability horrors around the POSIX filesystem abstraction in Linux -- it's a wonder anything works. 'Where's this documented? Oh, in some mailing list post 6-8 years ago (which makes it 12-14 years from today). The fs devs whose posts I've read are quite polite compared to LKML's reputation, and they generously spend a lot of time responding to basic questions, but it's hard for outsiders to troll [sic] through a decade and a half of mailing list postings to figure out which ones are still valid and which ones have been obsoleted! I don't mean to pick on filesystem devs. In their OSDI 2014 talk, the authors of the paper we're discussing noted that when they reported bugs they'd found, developers would often respond "POSIX doesn't let filesystems do that", without being able to point to any specific POSIX documentation to support their statement. If you've followed Kyle Kingsbury's Jepsen work, this may sound familiar, except devs respond with "filesystems don't do that" instead of "networks don't do that".I think this is understandable, given how much misinformation is out there. Not being a filesystem dev myself, I'd be a bit surprised if I don't have at least one bug in this post.'

    filesystems linux unix files operating-systems posix fsync osdi papers reliability

  • [LUCENE-6917] Deprecate and rename NumericField/RangeQuery to LegacyNumeric - ASF JIRA

    Interesting performance-related tweak going into Lucene -- based on the Bkd-Tree I think: https://users.cs.duke.edu/~pankaj/publications/papers/bkd-sstd.pdf . Being used for all numeric index types, not just multidimensional ones?

    lucene performance algorithms patches bkd-trees geodata numeric indexing

  • Kevin Lyda's mega pension post

    Cutting and pasting from Facebook for posterity... there are some really solid tips in here. 'Some people plan their lives out and then there are people like me who randomly do things and suddenly, in retrospect, it looks like a grand plan has come together. In reality it's more like my subconscious pulls in useful info and pokes me to go learn things as required. If you live/work in Ireland, the following "grand plan" might be useful. This year has apparently been "figure out how to retire" year. It started late last year with finally organising all my private Irish pensions (2 from employers, 1 personal). In the process I learned the following: * Many Irish pension plans allow you to start drawing down from them at age 50. There are downsides to this, but if you have several of them it allows you more room to avoid stock market downturns when you purchase annuities. * You can get 25% of each pension as a tax-free lump sum. I also learned a few property things. The key thing is that if you have a buy-to-let property you should *not* pay off its mortgage early. You can deduct 75% of the interest you pay against the taxes you'd owe for rental income. That means the interest you pay will essentially be close to or even under the rate of inflation. A residential mortgage might have a lower interest rate nominally, but the effective interest rate is higher. The Irish state pension is changing. If you are 68 after 2020 the rules have changed - and they're now much simpler. Work for 10 years and you get the minimum state pension (1/3 of a full pension). Work for 20, you get 2/3 of of a state pension. Work for 30, you get a full pension. But you can't collect it till you're 68 and remember that Irish employers can apparently force you to "retire" at 65 (ageism is legal). So you need to bridge those 3 years (or hope they change the law to stop employers from doing that). When I "retired" I kept a part time job for a number of reasons, but one was because I suspected I needed more PRSI credits for a pension. And it turns out this was correct. Part-time work counts as long as you make more than €38/week. And self-employment counts as long as you make more than €5,000/year. You can also make voluntary PRSI contributions (around €500/year but very situation dependent). If you've worked in Europe or the US or Canada or a few other countries, you can get credits for social welfare payments in those countries. But if you have enough here and you have enough for some pension in the other country, you can draw a pension from both. Lastly most people I've talked to about retirement this year have used the analogy of legs on a stool. Every source of post-retirement income is a leg on the stool - the more legs, the more secure your retirement. There are lots of options for legs: * Rental income. This is a little wobbly as legs go at least for me. But if you have more than one rental property - and better yet some commercial rental property - this leg firms up a bit. Still, it's a bit more work than most. * Savings. This isn't very tax-efficient, but it can help fill in blank spots some legs have (like rental income or age restrictions) or maximise another legs value (weathering downturns for stock-based legs). And in retirement you can even build savings up. Sell a house, the private pension lump sum, etc. But remember you're retired, go have fun. Savings won't do you much good when you're dead. * Stocks. I've cashed all mine in, but some friends have been more restrained in cashing in stocks they might have gotten from employers. This is a volatile leg, but it can pay off rather well if you know what you're doing. But be honest with yourself. I know I absolutely don't know what I'm doing on this so stayed away. * Government pension. This is generally a reliable source of income in retirement. It's usually not a lot, but it does tend to last from retirement to death and it shows up every month. You apply once and then it just shows up each month. If you've worked in multiple countries, you can hedge some bets by taking a pension in each country you qualify from. You did pay into them after all. * Private pension. This can also give you a solid source of income but you need to pay into it. And paying in during your 20s and 30s really pays off later. But you need to make your investments less risky as you get into your late 50s - so make sure to start looking at them then. And you need to provide yourself some flexibility for starting to draw it down in order to survive market drops. The crash in 2007 didn't fully recover until 2012 - that's 5 years. * Your home. Pay off your mortgage and your home can be a leg. Not having to pay rent/mortgage is a large expense removed and makes the other legs more effective. You can also "sell down" or look into things like reverse mortgages, but the former can take time and has costs while the latter usually seems to have a lot of fine print you should read up on. * Part-time work. I know a number of people who took part-time jobs when they retired. If you can find something that doesn't take a huge amount of time that you'd enjoy doing and that people will pay you for, fantastic! Do that. And it gets you out of the house and keeping active. For friends who are geeks and in my age cohort, I note that it will be 2037 around the time we hit 65. If you know why that matters, ka-ching!' Another particularly useful page about the state pension: "Six things every woman needs to know about the State pension", Irish Times, Dec 1 2015, https://www.irishtimes.com/business/personal-finance/six-things-every-woman-needs-to-know-about-the-state-pension-1.2448981 , which links to this page to get your state pension contribution record: http://www.welfare.ie/en/pages/secure/ RequestSIContributionRecord.aspx

    pensions money life via:klyda stocks savings shares property ireland old-age retirement

  • Big Brother Watch on Twitter: "Anyone can legally have their phone or computer hacked by the police, intelligence agencies, HMRC and others #IPBill https://t.co/3ZS610srCJ"

    As Glynn Moody noted, if UK police, intelligence agencies, HMRC and others call all legally hack phones and computers, that also means that digital evidence can be easily and invisibly planted. This will undermine future court cases in the UK, which seems like a significant own goal...

    hmrc police gchq uk hacking security law-enforcement evidence law

  • Why We Chose Kubernetes Over ECS

    3 months ago when we, at nanit.com, came to evaluate which Docker orchestration framework to use, we gave ECS the first priority. We were already familiar with AWS services, and since we already had our whole infrastructure there, it was the default choice. After testing the service for a while we had the feeling it was not mature enough and missing some key features we needed (more on that later), so we went to test another orchestration framework: Kubernetes. We were glad to discover that Kubernetes is far more comprehensive and had almost all the features we required. For us, Kubernetes won ECS on ECS's home court, which is AWS.

    kubernetes ecs docker containers aws ec2 ops

Links for 2015-12-11

Links for 2015-12-10

Links for 2015-12-09

Links for 2015-12-07

Links for 2015-12-03

  • Introducing Netty-HTTP from Cask

    netty-http library solves [Netty usability issues] by using JAX-RS annotations to build a HTTP path routing layer on top of netty. In addition, the library implements a guava service to manage the HTTP service. netty-http allows users of the library to just focus on writing the business logic in HTTP handlers without having to worry about the complexities of path routing or learning netty pipeline internals to build the HTTP service.
    We've written something very similar, although I didn't even bother supporting JAX-RS annotations -- just a simple code-level DSL.

    jax-rs netty http cask java services coding

  • The Locals Xmas Gift Guide 2015

    some nice local gift suggestions from small businesses around Dublin. I'd love to get some of these, but I guess I'll have to settle for giving them instead ;)

    gifts dublin ireland shopping xmas christmas the-locals

Links for 2015-12-02

  • Topics in High-Performance Messaging

    'We have worked together in the field of high-performance messaging for many years, and in that time, have seen some messaging systems that worked well and some that didn't. Successful deployment of a messaging system requires background information that is not easily available; most of what we know, we had to learn in the school of hard knocks. To save others a knock or two, we have collected here the essential background information and commentary on some of the issues involved in successful deployments. This information is organized as a series of topics around which there seems to be confusion or uncertainty. Please contact us if you have questions or comments.'

    messaging scalability scaling performance udp tcp protocols multicast latency

Links for 2015-11-30

  • Control theory meets machine learning

    'DB: Is there a difference between how control theorists and machine learning researchers think about robustness and error? BR: In machine learning, we almost always model our errors as being random rather than worst-case. In some sense, random errors are actually much more benign than worst-case errors. [...] In machine learning, by assuming average-case performance, rather than worst-case, we can design predictive algorithms by averaging out the errors over large data sets. We want to be robust to fluctuations in the data, but only on average. This is much less restrictive than the worst-case restrictions in controls. DB: So control theory is model-based and concerned with worst case. Machine learning is data based and concerned with average case. Is there a middle ground? BR: I think there is! And I think there's an exciting opportunity here to understand how to combine robust control and reinforcement learning. Being able to build systems from data alone simplifies the engineering process, and has had several recent promising results. Guaranteeing that these systems won't behave catastrophically will enable us to actually deploy machine learning systems in a variety of applications with major impacts on our lives. It might enable safe autonomous vehicles that can navigate complex terrains. Or could assist us in diagnostics and treatments in health care. There are a lot of exciting possibilities, and that's why I'm excited about how to find a bridge between these two viewpoints.'

    control-theory interviews machine-learning ml worst-case self-driving-cars cs

  • The End of Dynamic Languages

    This is my bet: the age of dynamic languages is over. There will be no new successful ones. Indeed we have learned a lot from them. We've learned that library code should be extendable by the programmer (mixins and meta-programming), that we want to control the structure (macros), that we disdain verbosity. And above all, we've learned that we want our languages to be enjoyable. But it's time to move on. We will see a flourishing of languages that feel like you're writing in a Clojure, but typed. Included will be a suite of powerful tools that we've never seen before, tools so convincing that only ascetics will ignore.

    programming scala clojure coding types strong-types dynamic-languages languages

  • RobustIRC

    'IRC without netsplits' using Raft consensus

    raft irc netsplits resilience fault-tolerance

  • Inside China's Memefacturing Factories, Where The Hottest New Gadgets Are Made - BuzzFeed News

    On a humid afternoon, Zhou went shopping for some of those very parts at a Bao An market. As he pulled his maroon minivan into a crowded parking lot, the full scale of Depu Electronics came into view: a three-story concrete behemoth roughly bigger than a Costco and roughly smaller than the Pentagon. Inside, it looked like the world's largest Radio Shack going out of business sale: an endless series of booths with cables and circuit boards and plugs and ports and buttons and machines piled so high on tables that the faces of the clerks who were selling them were hidden from view. Each booth seemed to argue: We have exactly what you want and we have enough of it for all of your customers. Short of motorized wheels and molding, the market offered nearly everything an ambitious factory owner would need to build a hoverboard, just waiting to be bought, assembled, and shipped.

    hoverboards memes china manufacturing future gadgets tat bao-an electronics

Links for 2015-11-28

Links for 2015-11-26

  • re:Work - The five keys to a successful Google team

    We learned that there are five key dynamics that set successful teams apart from other teams at Google: Psychological safety: Can we take risks on this team without feeling insecure or embarrassed? Dependability: Can we count on each other to do high quality work on time? Structure & clarity: Are goals, roles, and execution plans on our team clear? Meaning of work: Are we working on something that is personally important for each of us? Impact of work: Do we fundamentally believe that the work we're doing matters?

    teams google culture work management productivity hr

Links for 2015-11-25

Links for 2015-11-22

Links for 2015-11-20

Links for 2015-11-18

Links for 2015-11-17

Links for 2015-11-16

Links for 2015-11-13

  • The impact of Docker containers on the performance of genomic pipelines [PeerJ]

    In this paper, we have assessed the impact of Docker containers technology on the performance of genomic pipelines, showing that container "virtualization" has a negligible overhead on pipeline performance when it is composed of medium/long running tasks, which is the most common scenario in computational genomic pipelines. Interestingly for these tasks the observed standard deviation is smaller when running with Docker. This suggests that the execution with containers is more "homogeneous," presumably due to the isolation provided by the container environment. The performance degradation is more significant for pipelines where most of the tasks have a fine or very fine granularity (a few seconds or milliseconds). In this case, the container instantiation time, though small, cannot be ignored and produces a perceptible loss of performance.

    performance docker ops genomics papers

Links for 2015-11-12

Links for 2015-11-11

  • Dynalite

    Awesome new mock DynamoDB implementation:

    An implementation of Amazon's DynamoDB, focussed on correctness and performance, and built on LevelDB (well, @rvagg's awesome LevelUP to be precise). This project aims to match the live DynamoDB instances as closely as possible (and is tested against them in various regions), including all limits and error messages. Why not Amazon's DynamoDB Local? Because it's too buggy! And it differs too much from the live instances in a number of key areas.
    We use DynamoDBLocal in our tests -- the availability of that tool is one of the key reasons we have adopted Dynamo so heavily, since we can safely test our code properly with it. This looks even better.

    dynamodb testing unit-tests integration-testing tests ops dynalite aws leveldb

  • Alarm design: From nuclear power to WebOps

    Imagine you are an operator in a nuclear power control room. An accident has started to unfold. During the first few minutes, more than 100 alarms go off, and there is no system for suppressing the unimportant signals so that you can concentrate on the significant alarms. Information is not presented clearly; for example, although the pressure and temperature within the reactor coolant system are shown, there is no direct indication that the combination of pressure and temperature mean that the cooling water is turning into steam. There are over 50 alarms lit in the control room, and the computer printer registering alarms is running more than 2 hours behind the events. This was the basic scenario facing the control room operators during the Three Mile Island (TMI) partial nuclear meltdown in 1979. The Report of the President's Commission stated that, "Overall, little attention had been paid to the interaction between human beings and machines under the rapidly changing and confusing circumstances of an accident" (p. 11). The TMI control room operator on the day, Craig Faust, recalled for the Commission his reaction to the incessant alarms: "I would have liked to have thrown away the alarm panel. It wasn't giving us any useful information". It was the first major illustration of the alarm problem, and the accident triggered a flurry of human factors/ergonomics (HF/E) activity.
    A familiar topic for this ex-member of the Amazon network monitoring team...

    ergonomics human-factors ui ux alarms alerts alerting three-mile-island nuclear-power safety outages ops

  • An Analysis of Reshipping Mule Scams

    We observed that the vast majority of the re-shipped packages end up in the Moscow, Russia area, and that the goods purchased with stolen credit cards span multiple categories, from expensive electronics such as Apple products, to designer clothes, to DSLR cameras and even weapon accessories. Given the amount of goods shipped by the reshipping mule sites that we analysed, the annual revenue generated from such operations can span between 1.8 and 7.3 million US dollars. The overall losses are much higher though: the online merchant loses an expensive item from its inventory and typically has to refund the owner of the stolen credit card. In addition, the rogue goods typically travel labeled as "second hand goods" and therefore custom taxes are also evaded. Once the items purchased with stolen credit cards reach their destination they will be sold on the black market by cybercriminals. [...] When applying for the job, people are usually required to send the operator copies of their ID cards and passport. After they are hired, mules are promised to be paid at the end of their first month of employment. However, from our data it is clear that mules are usually never paid. After their first month expires, they are never contacted back by the operator, who just moves on and hires new mules. In other words, the mules become victims of this scam themselves, by never seeing a penny. Moreover, because they sent copies of their documents to the criminals, mules can potentially become victims of identity theft.

    crime law cybercrime mules shipping-scams identity-theft russia moscow scams papers

Links for 2015-11-10

  • No Harm, No Fowl: Chicken Farm Inappropriate Choice for Data Disposal

    That's a lesson that Spruce Manor Special Care Home in Saskatchewan had to learn the hard way (as surprising as that might sound). As a trustee with custody of personal health information, Spruce Manor was required under section 17(2) of the Saskatchewan Health Information Protection Act to dispose of its patient records in a way that protected patient privacy. So, when Spruce Manor chose a chicken farm for the job, it found itself the subject of an investigation by the Saskatchewan Information and Privacy Commissioner.  In what is probably one of the least surprising findings ever, the commissioner wrote in his final report that "I recommend that Spruce Manor […] no longer use [a] chicken farm to destroy records", and then for good measure added "I find using a chicken farm to destroy records unacceptable."

    data law privacy funny chickens farming via:pinboard data-protection health medical-records

Links for 2015-11-09

  • Caffeine cache adopts Window TinyLfu eviction policy

    'Caffeine is a Java 8 rewrite of Guava's cache. In this version we focused on improving the hit rate by evaluating alternatives to the classic least-recenty-used (LRU) eviction policy. In collaboration with researchers at Israel's Technion, we developed a new algorithm that matches or exceeds the hit rate of the best alternatives (ARC, LIRS). A paper of our work is being prepared for publication.' Specifically:

    W-TinyLfu uses a small admission LRU that evicts to a large Segmented LRU if accepted by the TinyLfu admission policy. TinyLfu relies on a frequency sketch to probabilistically estimate the historic usage of an entry. The window allows the policy to have a high hit rate when entries exhibit a high temporal / low frequency access pattern which would otherwise be rejected. The configuration enables the cache to estimate the frequency and recency of an entry with low overhead. This implementation uses a 4-bit CountMinSketch, growing at 8 bytes per cache entry to be accurate. Unlike ARC and LIRS, this policy does not retain non-resident keys.

    tinylfu caches caching cache-eviction java8 guava caffeine lru count-min sketching algorithms

  • What Do WebLogic, WebSphere, JBoss, Jenkins, OpenNMS, and Your Application Have in Common? This Vulnerability.

    The ever-shitty Java serialization creates a security hole

    java serialization security exploits jenkins

  • Gallery - Steffen Dam

    Danish glassware artist making wonderful Wunderkammers -- cabinets of curiosities --- entirely from glass. Seeing as one of his works sold for UKP50,000 last year, I suspect these are a bit out of my league, sadly

    art glassware steffen-dam wunderkammers museums

  • London garden bridge users to have mobile phone signals tracked

    If it goes ahead, people's progress across the structure would be tracked by monitors detecting the Wi-Fi signals from their phones, which show up the device's Mac address, or unique identifying code. The Garden Bridge Trust says it will not store any of this data and is only tracking phones to count numbers and prevent overcrowding.

    london surveillance mobile-phones mac-trackers tracking

  • Red lines and no-go zones - the coming surveillance debate

    The Anderson Report to the House of Lords in the UK on RIPA introduces a concept of a "red line":

    "Firm limits must also be written into the law: not merely safeguards, but red lines that may not be crossed." …    "Some might find comfort in a world in which our every interaction and movement could be recorded, viewed in real time and indefinitely retained for possible future use by the authorities. Crime fighting, security, safety or public health justifications are never hard to find." [13.19]  The Report then gives examples, such as a perpetual video feed from every room in every house, the police undertaking to view the record only on receipt of a complaint; blanket drone-based surveillance; licensed service providers, required as a condition of the licence to retain within the jurisdiction a complete plain-text version of every communication to be made available to the authorities on request; a constant data feed from vehicles, domestic appliances and health-monitoring personal devices; fitting of facial recognition software to every CCTV camera and the insertion of a location-tracking chip under every individual's skin. It goes on: "The impact of such powers on the innocent could be mitigated by the usual apparatus of safeguards, regulators and Codes of Practice. But a country constructed on such a basis would surely be intolerable to many of its inhabitants. A state that enjoyed all those powers would be truly totalitarian, even if the authorities had the best interests of its people at heart." [13.20] …   "The crucial objection is that of principle. Such a society would have gone beyond Bentham's Panopticon (whose inmates did not know they were being watched) into a world where constant surveillance was a certainty and quiescence the inevitable result. There must surely come a point (though it comes at different places for different people) where the escalation of intrusive powers becomes too high a price to pay for a safer and more law abiding environment." [13.21]

    panopticon jeremy-bentham law uk dripa ripa surveillance spying police drones facial-recognition future tracking cctv crime

  • Dublin is a medium-density city

    Comparable to Copenhagen or Amsterdam, albeit without sufficient cycling/public-transport infrastructural investment

    infrastructure density housing dublin ireland cities travel commuting cycling

Links for 2015-11-07

  • Ignoring ESR won't do anymore

    I'm tired of this shit. Full stop tired. It's 2015 and these turds who grope their way around conferences and the like can make allegations like this, get a hand wave and an, "Oh, that's just crazy Raymond!" Fuck that. Fuck it from here to hell and back. Here's a man who really hasn't done anything all that special, is a totally crazy gun-toting misogynist of the highest order and, yet, he remains mostly unchallenged after the tempest dies down, time after time. [...] I'm sure ESR will still be haunting conferences when your daughters reach their professional years unless you get serious about outing the assholes like him and making the community a lot less toxic than it is now.?
    Amen to that.

    esr toxic harassment conferences sexism misogyny culture

Links for 2015-11-05

Links for 2015-11-04

  • PICO-8:

    PICO-8 is a fantasy console for making, sharing and playing tiny games and other computer programs. When you turn it on, the machine greets you with a shell for typing in Lua commands and provides simple built-in tools for creating your own cartridges.
    So cute! See also Voxatron, something similar for voxel-oriented 3D gaming

    consoles games gaming lua coding retro 2d pico-8

  • Why Static Website Generators Are The Next Big Thing

    Now _this_ makes me feel old. Alternative title: "why static website generators have been a good idea since WebMake, 15 years ago". WebMake does pretty well on the checklist of "key features of the modern static website generator", which are: 1. Templating (check); 2. Markdown support (well, EtText, which predated Markdown by several years); 3. Metadata (check); and 4. Javascript asset pipeline (didn't support this one, since complex front-end DHTML JS wasn't really a thing at the turn of the century. But I would have if it had ;). So I guess I was on the right track!

    web html history webmake static-sites bake-dont-fry site-generators cms

  • Food Trucks Are Great Incubators. Why Don't We Have More?

    So is that kind of thriving food-truck scene something the city should work to encourage? Theresa Hernandez, one of the owners of K Chido Mexico, thinks so. "There's a whole market there for a new culture," she says. "There's no doubt about it, the appetite is there. It's just a matter for somebody who is innovative enough in Dublin City Council to say: 'Right, let's do this.'"
    Amen to that.

    k-chido food-trucks dublin food ireland dcc

  • wangle/Codel.h at master · facebook/wangle

    Facebook's open-source implementation of the CoDel queue management algorithm applied to server request-handling capacity in their C++ service bootstrap library, Wangle.

    wangle facebook codel services capacity reliability queueing

Links for 2015-11-02

  • Structural and semantic deficiencies in the systemd architecture for real-world service management, a technical treatise

    Despite its overarching abstractions, it is semantically non-uniform and its complicated transaction and job scheduling heuristics ordered around a dependently networked object system create pathological failure cases with little debugging context that would otherwise not necessarily occur on systems with less layers of indirection. The use of bus APIs complicate communication with the service manager and lead to duplication of the object model for little gain. Further, the unit file options often carry implicit state or are not sufficiently expressive. There is an imbalance with regards to features of an eager service manager and that of a lazy loading service manager, having rusty edge cases of both with non-generic, manager-specific facilities. The approach to logging and the circularly dependent architecture seem to imply that lots of prior art has been ignored or understudied.

    analysis systemd linux unix ops init critiques software logging

  • How Facebook avoids failures

    Great paper from Ben Maurer of Facebook in ACM Queue.

    A "move-fast" mentality does not have to be at odds with reliability. To make these philosophies compatible, Facebook's infrastructure provides safety valves.
    This is full of interesting techniques. * Rapidly deployed configuration changes: Make everybody use a common configuration system; Statically validate configuration changes; Run a canary; Hold on to good configurations; Make it easy to revert. * Hard dependencies on core services: Cache data from core services. Provide hardened APIs. Run fire drills. * Increased latency and resource exhaustion: Controlled Delay (based on the anti-bufferbloat CoDel algorithm -- this is really cool); Adaptive LIFO (last-in, first-out) for queue busting; Concurrency Control (essentially a form of circuit breaker). * Tools that Help Diagnose Failures: High-Density Dashboards with Cubism (horizon charts); What just changed? * Learning from Failure: the DERP (!) methodology,

    ben-maurer facebook reliability algorithms codel circuit-breakers derp failure ops cubism horizon-charts charts dependencies soa microservices uptime deployment configuration change-management

Links for 2015-11-01

Links for 2015-10-30

Links for 2015-10-29

  • Google tears Symantec a new one on its CA failure

    Symantec are getting a crash course in how to conduct an incident post-mortem to boot:

    More immediately, we are requesting of Symantec that they further update their public incident report with: A post-mortem analysis that details why they did not detect the additional certificates that we found. Details of each of the failures to uphold the relevant Baseline Requirements and EV Guidelines and what they believe the individual root cause was for each failure. We are also requesting that Symantec provide us with a detailed set of steps they will take to correct and prevent each of the identified failures, as well as a timeline for when they expect to complete such work. Symantec may consider this latter information to be confidential and so we are not requesting that this be made public.

    google symantec ev ssl certificates ca security postmortems ops

  • Google is Maven Central's New Best Friend

    google now mirroring Maven Central.

    google maven maven-central jars hosting java packages build

  • Apache Kafka, Purgatory, and Hierarchical Timing Wheels

    In the new design, we use Hierarchical Timing Wheels for the timeout timer and DelayQueue of timer buckets to advance the clock on demand. Completed requests are removed from the timer queue immediately with O(1) cost. The buckets remain in the delay queue, however, the number of buckets is bounded. And, in a healthy system, most of the requests are satisfied before timeout, and many of the buckets become empty before pulled out of the delay queue. Thus, the timer should rarely have the buckets of the lower interval. The advantage of this design is that the number of requests in the timer queue is the number of pending requests exactly at any time. This allows us to estimate the number of requests need to be purged. We can avoid unnecessary purge operation of the watcher lists. As the result we achieve a higher scalability in terms of request rate with much better CPU usage.

    algorithms timers kafka scheduling timing-wheels delayqueue queueing

Links for 2015-10-28

Links for 2015-10-27

Links for 2015-10-23

Links for 2015-10-22

Links for 2015-10-21

Links for 2015-10-20

  • Hologram

    Hologram exposes an imitation of the EC2 instance metadata service on developer workstations that supports the [IAM Roles] temporary credentials workflow. It is accessible via the same HTTP endpoint to calling SDKs, so your code can use the same process in both development and production. The keys that Hologram provisions are temporary, so EC2 access can be centrally controlled without direct administrative access to developer workstations.

    iam roles ec2 authorization aws adroll open-source cli osx coding dev

Links for 2015-10-18

Links for 2015-10-16

  • Your Relative's DNA Could Turn You Into A Suspect

    Familial DNA searching has massive false positives, but is being used to tag suspects:

    The bewildered Usry soon learned that he was a suspect in the 1996 murder of an Idaho Falls teenager named Angie Dodge. Though a man had been convicted of that crime after giving an iffy confession, his DNA didn't match what was found at the crime scene. Detectives had focused on Usry after running a familial DNA search, a technique that allows investigators to identify suspects who don't have DNA in a law enforcement database but whose close relatives have had their genetic profiles cataloged. In Usry's case the crime scene DNA bore numerous similarities to that of Usry's father, who years earlier had donated a DNA sample to a genealogy project through his Mormon church in Mississippi. That project's database was later purchased by Ancestry, which made it publicly searchable—a decision that didn't take into account the possibility that cops might someday use it to hunt for genetic leads. Usry, whose story was first reported in The New Orleans Advocate, was finally cleared after a nerve-racking 33-day wait — the DNA extracted from his cheek cells didn't match that of Dodge's killer, whom detectives still seek. But the fact that he fell under suspicion in the first place is the latest sign that it's time to set ground rules for familial DNA searching, before misuse of the imperfect technology starts ruining lives.

    dna familial-dna false-positives law crime idaho murder mormon genealogy ancestry.com databases biometrics privacy genes

Links for 2015-10-15

  • Cluster benchmark: Scylla vs Cassandra

    ScyllaDB (the C* clone in C++) is now actually looking promising -- still need more reassurance about its consistency/reliabilty side though

    scylla databases storage cassandra nosql

  • _What We Know About Spreadsheet Errors_ [paper]

    As we will see below, there has long been ample evidence that errors in spreadsheets are pandemic. Spreadsheets, even after careful development, contain errors in one percent or more of all formula cells. In large spreadsheets with thousands of formulas, there will be dozens of undetected errors. Even significant errors may go undetected because formal testing in spreadsheet development is rare and because even serious errors may not be apparent.

    business coding maths excel spreadsheets errors formulas error-rate

  • Defending Your Time

    great post from Ross Duggan on avoiding developer burnout

    coding burnout productivity work

  • How is NSA breaking so much crypto?

    If a client and server are speaking Diffie-Hellman, they first need to agree on a large prime number with a particular form. There seemed to be no reason why everyone couldn't just use the same prime, and, in fact, many applications tend to use standardized or hard-coded primes. But there was a very important detail that got lost in translation between the mathematicians and the practitioners: an adversary can perform a single enormous computation to "crack" a particular prime, then easily break any individual connection that uses that prime. How enormous a computation, you ask? Possibly a technical feat on a scale (relative to the state of computing at the time) not seen since the Enigma cryptanalysis during World War II. Even estimating the difficulty is tricky, due to the complexity of the algorithm involved, but our paper gives some conservative estimates. For the most common strength of Diffie-Hellman (1024 bits), it would cost a few hundred million dollars to build a machine, based on special purpose hardware, that would be able to crack one Diffie-Hellman prime every year. Would this be worth it for an intelligence agency? Since a handful of primes are so widely reused, the payoff, in terms of connections they could decrypt, would be enormous. Breaking a single, common 1024-bit prime would allow NSA to passively decrypt connections to two-thirds of VPNs and a quarter of all SSH servers globally. Breaking a second 1024-bit prime would allow passive eavesdropping on connections to nearly 20% of the top million HTTPS websites. In other words, a one-time investment in massive computation would make it possible to eavesdrop on trillions of encrypted connections.
    (via Eric)

    via:eric encryption privacy security nsa crypto

Links for 2015-10-14

Links for 2015-10-13

  • Chromecast Speakers

    Supports Spotify -- totally getting one of these

    spotify speakers music home google gadgets toget

  • Where do 'mama'/'papa' words come from?

    The sounds came first — as experiments in vocalization — and parents adopted them as pet names for themselves. If you open your mouth and make a sound, it will probably be an open vowel like /a/ unless you move your tongue or lips. The easiest consonants are perhaps the bilabials /m/, /p/, and /b/, requiring no movement of the tongue, followed by consonants made by raising the front of the tongue: /d/, /t/, and /n/. Add a dash of reduplication, and you get mama, papa, baba, dada, tata, nana. That such words refer to people (typically parents or other guardians) is something we have imposed on the sounds and incorporated into our languages and cultures; the meanings don't inhere in the sounds as uttered by babies, which are more likely calls for food or attention.

    sounds voice speech babies kids phonetics linguist language

  • remind101/conveyor

    'A fast build system for Docker images', open source, in Go, hooks into Github

    build ci docker github go

  • England opens up 11TB of LiDAR data covering the entire country as open data

    All 11 terabytes of our LIDAR data (that's roughly equivalent to 2,750,000 MP3 songs) will eventually be available through our new Open LIDAR portal under an Open Government Licence, allowing it to be used for any purpose. We hope that by giving free access to our data businesses and local communities will develop innovative solutions to benefit the environment, grow our thriving rural economy, and boost our world-leading food and farming industry. The possibilities are endless and we hope that making LIDAR data open will be a catalyst for new ideas and innovation.
    Are you reading, Ordnance Survey Ireland?

    data maps uk lidar mapping geodata open-data ogl

Links for 2015-10-12

  • SuperChief: From Apache Storm to In-House Distributed Stream Processing

    Another sorry tale of Storm issues:

    Storm has been successful at Librato, but we experienced many of the limitations cited in the Twitter Heron: Stream Processing at Scale paper and outlined here by Adrian Colyer, including: Inability to isolate, reason about, or debug performance issues due to the worker/executor/task paradigm. This led to building and configuring clusters specifically designed to attempt to mitigate these problems (i.e., separate clusters per topology, only running a worker per server.), which added additional complexity to development and operations and also led to over-provisioning. Ability of tasks to move around led to difficult to trace performance problems. Storm's work provisioning logic led to some tasks serving more Kafka partitions than others. This in turn created latency and performance issues that were difficult to reason about. The initial solution was to over-provision in an attempt to get a better hashing/balancing of work, but eventually we just replaced the work allocation logic. Due to Storm's architecture, it was very difficult to get a stack trace or heap dump because the processes that managed workers (Storm supervisor) would often forcefully kill a Java process while it was being investigated in this way. The propensity for unexpected and subsequently unhandled exceptions to take down an entire worker led to additional defensive verbose error handling everywhere. This nasty bug STORM-404 coupled with the aforementioned fact that a single exception can take down a worker led to several cascading failures in production, taking down entire topologies until we upgraded to 0.9.4. Additionally, we found the performance we were getting from Storm for the amount of money we were spending on infrastructure was not in line with our expectations. Much of this is due to the fact that, depending upon how your topology is designed, a single tuple may make multiple hops across JVMs, and this is very expensive. For example, in our time series aggregation topologies a single tuple may be serialized/deserialized and shipped across the wire 3-4 times as it progresses through the processing pipeline.

    scalability storm kafka librato architecture heron ops

  • librato/disco-java

    Librato's service discovery library using Zookeeper (so strongly consistent, but with the ZK downside that an AZ outage can stall service discovery updates region-wide)

    zookeeper service-discovery librato java open-source load-balancing

  • Tech companies like Facebook not above the law, says Max Schrems

    "Big companies didn't only rely on safe harbour: they also rely on binding corporate rules and standard contractual clauses. But it's interesting that the court decided the case on fundamental rights grounds: so it doesn't matter remotely what ground you transfer on, if that process is still illegal under 7 and 8 of charter, it can't be done."
    Also:
    "Ireland has no interest in doing its job, and will continue not to, forever. Clearly it's an investment issue – but overall the policy is: we don't regulate companies here. The cost of challenging any of this in the courts is prohibitive. And the people don't seem to care."
    :(

    ireland guardian max-schrems privacy surveillance safe-harbor eu us nsa dpc data-protection

  • After Bara: All your (Data)base are belong to us

    Sounds like the CJEU's Bara decision may cause problems for the Irish government's wilful data-sharing:

    Articles 10, 11 and 13 of Directive 95/46/EC of the European Parliament and of the Council of 24 October 1995, on the protection of individuals with regard to the processing of personal data and on the free movement of such data, must be interpreted as precluding national measures, such as those at issue in the main proceedings, which allow a public administrative body of a Member State to transfer personal data to another public administrative body and their subsequent processing, without the data subjects having been informed of that transfer or processing.

    data databases bara cjeu eu law privacy data-protection

Links for 2015-10-10

  • Outage postmortem (2015-10-08 UTC) : Stripe: Help & Support

    There was a breakdown in communication between the developer who requested the index migration and the database operator who deleted the old index. Instead of working on the migration together, they communicated in an implicit way through flawed tooling. The dashboard that surfaced the migration request was missing important context: the reason for the requested deletion, the dependency on another index's creation, and the criticality of the index for API traffic. Indeed, the database operator didn't have a way to check whether the index had recently been used for a query.
    Good demo of how the Etsy-style chatops deployment approach would have helped avoid this risk.

    stripe postmortem outages databases indexes deployment chatops deploy ops

  • net.wars: Unsafe harbor

    Wendy Grossman on where the Safe Harbor decision is leading.

    One clause would require European companies to tell their relevant data protection authorities if they are being compelled to turn over data - even if they have been forbidden to disclose this under US law. Sounds nice, but doesn't mobilize the rock or soften the hard place, since companies will still have to pick a law to violate. I imagine the internal discussions there revolving around two questions: which violation is less likely to land the CEO in jail and which set of fines can we afford?
    (via Simon McGarr)

    safe-harbor privacy law us eu surveillance wendy-grossman via:tupp_ed

  • CHICKEN COOP & RUN

    bookmarking as a potential future addition to the back garden

    chickens pets food garden ebay

Links for 2015-10-09

Links for 2015-10-08

  • Fuzzing Raft for Fun and Publication

    Good intro to fuzz-testing a distributed system; I've had great results using similar approaches in unit tests

    fuzzing fuzz-testing testing raft akka tests

  • EC2 Spot Blocks for Defined-Duration Workloads

    you can now launch Spot instances that will run continuously for a finite duration (1 to 6 hours). Pricing is based on the requested duration and the available capacity, and is typically 30% to 45% less than On-Demand.

    ec2 aws spot-instances spot pricing time

  • The Surveillance Elephant in the Room…

    Very perceptive post on the next steps for safe harbor, post-Schrems.

    And behind that elephant there are other elephants: if US surveillance and surveillance law is a problem, then what about UK surveillance? Is GCHQ any less intrusive than the NSA? It does not seem so – and this puts even more pressure on the current reviews of UK surveillance law taking place. If, as many predict, the forthcoming Investigatory Powers Bill will be even more intrusive and extensive than current UK surveillance laws this will put the UK in a position that could rapidly become untenable. If the UK decides to leave the EU, will that mean that the UK is not considered a safe place for European data? Right now that seems the only logical conclusion – but the ramifications for UK businesses could be huge. [....] What happens next, therefore, is hard to foresee. What cannot be done, however, is to ignore the elephant in the room. The issue of surveillance has to be taken on. The conflict between that surveillance and fundamental human rights is not a merely semantic one, or one for lawyers and academics, it's a real one. In the words of historian and philosopher Quentin Skinner "the current situation seems to me untenable in a democratic society." The conflict over Safe Harbor is in many ways just a symptom of that far bigger problem. The biggest elephant of all.

    ec cjeu surveillance safe-harbor schrems privacy europe us uk gchq nsa

  • ECJ ruling on Irish privacy case has huge significance

    The only current way to comply with EU law, the judgment indicates, is to keep EU data within the EU. Whether those data can be safely managed within facilities run by US companies will not be determined until the US rules on an ongoing Microsoft case. Microsoft stands in contempt of court right now for refusing to hand over to US authorities, emails held in its Irish data centre. This case will surely go to the Supreme Court and will be an extremely important determination for the cloud business, and any company or individual using data centre storage. If Microsoft loses, US multinationals will be left scrambling to somehow, legally firewall off their EU-based data centres from US government reach.
    (cough, Amazon)

    aws hosting eu privacy surveillance gchq nsa microsoft ireland

Links for 2015-10-07

Links for 2015-10-06

  • Marvin.ie: Order Takeaway Food Online

    new Dublin delivery service takes Bitcoin?!

    bitcoin food delivery takeaway payment ireland dublin wtf

  • qp tries: smaller and faster than crit-bit tries

    interesting new data structure from Tony Finch. "Some simple benchmarks say qp tries have about 1/3 less memory overhead and are about 10% faster than crit-bit tries."

    crit-bit popcount bits bitmaps tries data-structures via:fanf qp-tries crit-bit-tries hacks memory

  • Schneier on Automatic Face Recognition and Surveillance

    When we talk about surveillance, we tend to concentrate on the problems of data collection: CCTV cameras, tagged photos, purchasing habits, our writings on sites like Facebook and Twitter. We think much less about data analysis. But effective and pervasive surveillance is just as much about analysis. It's sustained by a combination of cheap and ubiquitous cameras, tagged photo databases, commercial databases of our actions that reveal our habits and personalities, and ­-- most of all ­-- fast and accurate face recognition software. Don't expect to have access to this technology for yourself anytime soon. This is not facial recognition for all. It's just for those who can either demand or pay for access to the required technologies ­-- most importantly, the tagged photo databases. And while we can easily imagine how this might be misused in a totalitarian country, there are dangers in free societies as well. Without meaningful regulation, we're moving into a world where governments and corporations will be able to identify people both in real time and backwards in time, remotely and in secret, without consent or recourse. Despite protests from industry, we need to regulate this budding industry. We need limitations on how our images can be collected without our knowledge or consent, and on how they can be used. The technologies aren't going away, and we can't uninvent these capabilities. But we can ensure that they're used ethically and responsibly, and not just as a mechanism to increase police and corporate power over us.

    privacy regulation surveillance bruce-schneier faces face-recognition machine-learning ai cctv photos

Links for 2015-10-05

Links for 2015-10-02

Links for 2015-10-01

Links for 2015-09-30

Links for 2015-09-29

Links for 2015-09-28

Links for 2015-09-24

  • Byteman

    a tool which simplifies tracing and testing of Java programs. Byteman allows you to insert extra Java code into your application, either as it is loaded during JVM startup or even after it has already started running. The injected code is allowed to access any of your data and call any application methods, including where they are private. You can inject code almost anywhere you want and there is no need to prepare the original source code in advance nor do you have to recompile, repackage or redeploy your application. In fact you can remove injected code and reinstall different code while the application continues to execute. The simplest use of Byteman is to install code which traces what your application is doing. This can be used for monitoring or debugging live deployments as well as for instrumenting code under test so that you can be sure it has operated correctly. By injecting code at very specific locations you can avoid the overheads which often arise when you switch on debug or product trace. Also, you decide what to trace when you run your application rather than when you write it so you don't need 100% hindsight to be able to obtain the information you need.

    tracing java byteman injection jvm ops debugging testing

  • Henry Robinson on testing and fault discovery in distributed systems

    'Let's talk about finding bugs in distributed systems for a bit. These chaos monkey-style fault testing systems are all well and good, but by being application independent they're a very blunt instrument. Particularly they make it hard to search the fault space for bugs in a directed manner, because they don't 'know' what the system is doing. Application-aware scripting of faults in a dist. systems seems to be rarely used, but allows you to directly stress problem areas. For example, if a bug manifests itself only when one RPC returns after some timeout, hard to narrow that down with iptables manipulation. But allow a script to hook into RPC invocations (and other trace points, like DTrace's probes), and you can script very specific faults. That way you can simulate cross-system integration failures, *and* write reproducible tests for the bugs they expose! Anyhow, I've been doing this in Impala, and it's been very helpful. Haven't seen much evidence elsewhere.'

    henry-robinson testing fault-discovery rpc dtrace tracing distributed-systems timeouts chaos-monkey impala

  • The Best Bourbon Cocktail You've Never Heard Of

    The "Paper Plane", by Sam Ross of Chicago's "Violet Hour": .75 oz Bourbon .75 oz Aperol .75 oz Amaro Nonino .75 oz Fresh lemon juice ice-filled shaker, shake, strain.

    bourbon drinks cocktails recipes aperol amaro-nonino lemon

  • Seastar

    C++ high-performance app framework; 'currently focused on high-throughput, low-latency I/O intensive applications.' Scylla (Cassandra-compatible NoSQL store) is written in this.

    c++ opensource performance framework scylla seastar latency linux shared-nothing multicore

Links for 2015-09-23

Links for 2015-09-22

  • Brotli: a new compression algorithm for the internet from Google

    While Zopfli is Deflate-compatible, Brotli is a whole new data format. This new format allows us to get 20–26% higher compression ratios over Zopfli. In our study 'Comparison of Brotli, Deflate, Zopfli, LZMA, LZHAM and Bzip2 Compression Algorithms' we show that Brotli is roughly as fast as zlib's Deflate implementation. At the same time, it compresses slightly more densely than LZMA and bzip2 on the Canterbury corpus. The higher data density is achieved by a 2nd order context modeling, re-use of entropy codes, larger memory window of past data and joint distribution codes. Just like Zopfli, the new algorithm is named after Swiss bakery products. Brötli means 'small bread' in Swiss German.

    brotli zopfli deflate gzip compression algorithms swiss google

Links for 2015-09-21

  • Nelson recommends Ubiquiti

    'The key thing about Ubiquiti gear is the high quality radios and antennas. It just seems much more reliable than most consumer WiFi gear. Their airOS firmware is good too, it's a bit complicated to set up but very capable and flexible. And in addition to normal 802.11n or 802.11ac they also have an optional proprietary TDMA protocol called airMax that's designed for serving several long haul links from a single basestation. They're mostly marketing to business customers but the equipment is sold retail and well documented for ordinary nerds to figure out.'

    ubiquiti wifi wireless 802.11 via:nelson ethernet networking prosumer hardware wan

  • httpry

    a specialized packet sniffer designed for displaying and logging HTTP traffic. It is not intended to perform analysis itself, but to capture, parse, and log the traffic for later analysis. It can be run in real-time displaying the traffic as it is parsed, or as a daemon process that logs to an output file. It is written to be as lightweight and flexible as possible, so that it can be easily adaptable to different applications.
    via Eoin Brazil

    via:eoinbrazil httpry http networking tools ops testing tcpdump tracing

  • ustwo Reimagines the In-Car Cluster

    Designers behind the cult mobile game, Monument Valley, take on the legacy-bound in-car UI

    ux ui cars driving safety ustwo monument-valley speed

  • Little Drummer Boy Challenge

    'It's very easy: So long as you don't hear "The Little Drummer Boy," you're a contender. As soon as you hear it on the radio, on TV, in a store, wherever, you're out.'

    ldbc games funny xmas christmas music songs cheese

Links for 2015-09-18

Links for 2015-09-14

  • Kate Heddleston: How Our Engineering Environments Are Killing Diversity

    '[There are] several problem areas for [diversity in] engineering environments and ways to start fixing them. The problems we face aren't devoid of solutions; there are a lot of things that companies, teams, and individuals can do to fix problems in their work environment. For the month of March, I will be posting detailed articles about the problem areas I will cover in my talk: argument cultures, feedback, promotions, employee on-boarding, benefits, safety, engineering process, and environment adaptation.' via Baron Schwartz.

    via:xaprb culture tech diversity sexism feminism engineering work workplaces feedback

  • Michael Kagan | Prints

    'Heavily tinted blue paintings form space stations, spacesuits, and rockets just after blast. Michael Kagan paints these large-scale works to celebrate the man-made object—machinery that both protects and holds the possibility of instantly killing those that operate the equipment from the inside. To paint the large works, Kagan utilizes an impasto technique with thick strokes that are deliberate and unique, showing an aggression in his application of oil paint on linen. The New York-based artist focuses on iconic images in his practice, switching back and forth between abstract and representational styles. "The painting is finished when it can fall apart and come back together depending on how it is read and the closeness to the work," said Kagan about his work. "Each painting is an image, a snapshot, a flash moment, a quick read that is locked into memory by the iconic silhouettes."' Via http://www.thisiscolossal.com/2015/08/michael-kagens-space-paintings/

    paintings prints art michael-kagan space abstract-art tobuy

  • Dark corners of Unicode

    I'm assuming, if you are on the Internet and reading kind of a nerdy blog, that you know what Unicode is. At the very least, you have a very general understanding of it — maybe "it's what gives us emoji". That's about as far as most people's understanding extends, in my experience, even among programmers. And that's a tragedy, because Unicode has a lot of… ah, depth to it. Not to say that Unicode is a terrible disaster — more that human language is a terrible disaster, and anything with the lofty goals of representing all of it is going to have some wrinkles. So here is a collection of curiosities I've encountered in dealing with Unicode that you generally only find out about through experience. Enjoy.

    unicode characters encoding emoji utf-8 utf-16 utf mysql text

Links for 2015-09-08

Links for 2015-09-07

  • You're probably wrong about caching

    Excellent cut-out-and-keep guide to why you should add a caching layer. I've been following this practice for the past few years, after I realised that #6 (recovering from a failed cache is hard) is a killer -- I've seen a few large-scale outages where a production system had gained enough scale that it required a cache to operate, and once that cache was damaged, bringing the system back online required a painful rewarming protocol. Better to design for the non-cached case if possible.

    architecture caching coding design caches ops production scalability

  • The Alternative Universe Of Soviet Arcade Games

    Unlike machines in the West, every single machine that was produced during Soviet-era Russia had to align with Marxist ideology. [...] The most popular games were created to teach hand-eye coordination, reaction speed, and logical, focused thinking. Not unlike many American games, these games were influenced by military training, crafted to teach and instill patriotism for the state by making the human body better, stronger, and more willful. It also means no high scores, no adrenaline rushes, or self-serving feather-fluffing as you add your hard-earned initials to the list of the best. In Communist Russia, there was no overt competition.

    high-scores communism russia cccp ussr arcade-games games history

Links for 2015-09-03

Links for 2015-09-02

Links for 2015-09-01

  • What Are the Worst Airports in the World?

    this is a great resource when picking a stopover for a 2-stop flight. Pity "best kids play area" isn't a criterion

    airports comparison via:boingboing flying travel ranking world skytrax

  • Using Samsung's Internet-Enabled Refrigerator for Man-in-the-Middle Attacks

    Whilst the fridge implements SSL, it FAILS to validate SSL certificates, thereby enabling man-in-the-middle attacks against most connections. This includes those made to Google's servers to download Gmail calendar information for the on-screen display. So, MITM the victim's fridge from next door, or on the road outside and you can potentially steal their Google credentials.
    The Internet of Insecure Things strikes again.

    iot security fridges samsung fail mitm ssl tls google papers defcon

  • Malware infecting jailbroken iPhones stole 225,000 Apple account logins | Ars Technica

    KeyRaider, as the malware family has been dubbed, is distributed through a third-party repository of Cydia, which markets itself as an alternative to Apple's official App Store. Malicious code surreptitiously included with Cydia apps is creating problems for people in China and at least 17 other countries, including France, Russia, Japan, and the UK. Not only has it pilfered account data for 225,941 Apple accounts, it has also disabled some infected phones until users pay a ransom, and it has made unauthorized charges against some victims' accounts.
    Ouch. Not a good sign for Cydia

    cydia apple security exploits jailbreaking ios iphone malware keyraider china

  • GoTTY

    'a simple command line tool that turns your CLI tools into web applications'

    cli terminal web tools unix

  • S3QL

    a file system that stores all its data online using storage services like Google Storage, Amazon S3, or OpenStack. S3QL effectively provides a hard disk of dynamic, infinite capacity that can be accessed from any computer with internet access running Linux, FreeBSD or OS-X. S3QL is a standard conforming, full featured UNIX file system that is conceptually indistinguishable from any local file system. Furthermore, S3QL has additional features like compression, encryption, data de-duplication, immutable trees and snapshotting which make it especially suitable for online backup and archival. S3QL is designed to favor simplicity and elegance over performance and feature-creep. Care has been taken to make the source code as readable and serviceable as possible. Solid error detection and error handling have been included from the very first line, and S3QL comes with extensive automated test cases for all its components.

    filesystems aws s3 storage unix google-storage openstack

Links for 2015-08-31

Links for 2015-08-28

  • toxy

    toxy is a fully programmatic and hackable HTTP proxy to simulate server failure scenarios and unexpected network conditions. It was mainly designed for fuzzing/evil testing purposes, when toxy becomes particularly useful to cover fault tolerance and resiliency capabilities of a system, especially in service-oriented architectures, where toxy may act as intermediate proxy among services. toxy allows you to plug in poisons, optionally filtered by rules, which essentially can intercept and alter the HTTP flow as you need, performing multiple evil actions in the middle of that process, such as limiting the bandwidth, delaying TCP packets, injecting network jitter latency or replying with a custom error or status code.

    toxy proxies proxy http mitm node.js soa network failures latency slowdown jitter bandwidth tcp

  • Drone Oversight Is Coming to Construction Sites

    Grim Meathook Future

    grim-meathook-future drones work panopticon future sacramento building-sites

  • grsecurity

    Open source security team has had enough of embedded-systems vendors taking the piss with licensing:

    This announcement is our public statement that we've had enough. Companies in the embedded industry not playing by the same rules as every other company using our software violates users' rights, misleads users and developers, and harms our ability to continue our work. Though I've only gone into depth in this announcement on the latest trademark violation against us, our experience with two GPL violations over the previous year have caused an incredible amount of frustration. These concerns are echoed by the complaints of many others about the treatment of the GPL by the embedded Linux industry in particular over many years. With that in mind, today's announcement is concerned with the future availability of our stable series of patches. We decided that it is unfair to our sponsors that the above mentioned unlawful players can get away with their activity. Therefore, two weeks from now, we will cease the public dissemination of the stable series and will make it available to sponsors only. The test series, unfit in our view for production use, will however continue to be available to the public to avoid impact to the Gentoo Hardened and Arch Linux communities. If this does not resolve the issue, despite strong indications that it will have a large impact, we may need to resort to a policy similar to Red Hat's, described here or eventually stop the stable series entirely as it will be an unsustainable development model.

    culture gpl linux opensource security grsecurity via:nelson gentoo arch-linux gnu

  • London Calling: Two-Factor Authentication Phishing From Iran

    some rather rudimentary anti-2FA attempts, presumably from Iranian security services

    authentication phishing security iran activism 2fa mfa

  • Vegemite May Power The Electronics Of The Future

    Professor Marc in het Panhuis at the ARC Centre of Excellence for Electromaterials Science figured out that you can 3D print the paste and use it to carry current, effectively creating Vegemite bio-wires. What does this mean? Soon you can run electricity through your food. "The iconic Australian Vegemite is ideal for 3D printing edible electronics," said the professor. "It contains water so it's not a solid and can easily be extruded using a 3D printer. Also, it's salty, so it conducts electricity."
    I'm sure the same applies for Marmite...

    vegemite marmite 3d-printing electronics bread food silly

  • Beoir.org Community - Recent Attack on McGargles

    bizarre conspiracy theory going around about McGargles microbrewery being owned by Molson in an "astroturf craft beer" operation -- they apparently were set up by a bunch of ex-Molson employees. Their beer is getting stickered in off-licenses. Mental!

    beer craft-beer ireland mcgargles conspiracy-theories bizarre beoir

Links for 2015-08-27

  • Mining High-Speed Data Streams: The Hoeffding Tree Algorithm

    This paper proposes a decision tree learner for data streams, the Hoeffding Tree algorithm, which comes with the guarantee that the learned decision tree is asymptotically nearly identical to that of a non-incremental learner using infinitely many examples. This work constitutes a significant step in developing methodology suitable for modern 'big data' challenges and has initiated a lot of follow-up research. The Hoeffding Tree algorithm has been covered in various textbooks and is available in several public domain tools, including the WEKA Data Mining platform.

    hoeffding-tree algorithms data-structures streaming streams cep decision-trees ml learning papers

  • Chinese scammers are now using Stingray tech to SMS-phish

    A Stingray-style false GSM base station, hidden in a backpack; presumably they detect numbers in the vicinity, and SMS-spam those numbers with phishing messages. Reportedly the scammers used this trick in "Guangzhou, Zhuhai, Shenzhen, Changsha, Wuhan, Zhengzhou and other densely populated cities". Dodgy machine translation:

    March 26, Zhengzhou police telecommunications fraud cases together, for the first time seized a small backpack can hide pseudo station equipment, and arrested two suspects. Yesterday, the police informed of this case, to remind the general public to pay attention to prevention. "I am the landlord, I changed number, please rent my wife hit the bank card, card number ×××, username ××." Recently, Jiefang Road, Zhengzhou City Public Security Bureau police station received a number of cases for investigation brigade area of ??the masses police said, frequently received similar phone scam messages. Alarm, the police investigators to determine: the suspect may be in the vicinity of twenty-seven square, large-scale use of mobile pseudo-base release fraudulent information. [...] Yesterday afternoon, the Jiefang Road police station, the reporter saw the portable pseudo-base is made up of two batteries, a set-top box the size of the antenna box and a chassis, as well as a pocket computer composed together at most 5 kg.
    (via t byfield and Danny O'Brien)

    via:mala via:tbyfield privacy scams phishing sms gsm stingray base-stations mobile china

Links for 2015-08-25

Links for 2015-08-23

Links for 2015-08-22

Links for 2015-08-19

Links for 2015-08-18

Links for 2015-08-17

  • The world beyond batch: Streaming 101 - O'Reilly Media

    To summarize, in this post I've: Clarified terminology, specifically narrowing the definition of "streaming" to apply to execution engines only, while using more descriptive terms like unbounded data and approximate/speculative results for distinct concepts often categorized under the "streaming" umbrella. Assessed the relative capabilities of well-designed batch and streaming systems, positing that streaming is in fact a strict superset of batch, and that notions like the Lambda Architecture, which are predicated on streaming being inferior to batch, are destined for retirement as streaming systems mature. Proposed two high-level concepts necessary for streaming systems to both catch up to and ultimately surpass batch, those being correctness and tools for reasoning about time, respectively. Established the important differences between event time and processing time, characterized the difficulties those differences impose when analyzing data in the context of when they occurred, and proposed a shift in approach away from notions of completeness and toward simply adapting to changes in data over time. Looked at the major data processing approaches in common use today for bounded and unbounded data, via both batch and streaming engines, roughly categorizing the unbounded approaches into: time-agnostic, approximation, windowing by processing time, and windowing by event time.

    streaming batch big-data lambda-architecture dataflow event-processing cep millwheel data data-processing

  • What the hell is going on with SoundCloud?

    tl;dr: major labels.

    Despite having revenue coming in from ads and subscriptions, SoundCloud still relies on outside investment. While the company received $150 million in a funding round at the end of last year, it pales next to the reported $526 million Spotify gained in June, and if one report is to be believed, SoundCloud is running very low on cash. Furthermore, sources suggest that potential investors are waiting to see what happens with Sony and Universal before ploughing in more money. With the high sums reported to be involved, it's a stalemate that could potentially break the company whether it decides to pay or not.

    soundcloud music mp3 copyright sony universal spotify funding startups

  • GSMem: Data Exfiltration from Air-Gapped Computers over GSM Frequencies

    Holy shit.

    Air-gapped networks are isolated, separated both logically and physically from public networks. Although the feasibility of invading such systems has been demonstrated in recent years, exfiltration of data from air-gapped networks is still a challenging task. In this paper we present GSMem, a malware that can exfiltrate data through an air-gap over cellular frequencies. Rogue software on an infected target computer modulates and transmits electromagnetic signals at cellular frequencies by invoking specific memory-related instructions and utilizing the multichannel memory architecture to amplify the transmission. Furthermore, we show that the transmitted signals can be received and demodulated by a rootkit placed in the baseband firmware of a nearby cellular phone.

    gsmem gsm exfiltration air-gaps memory radio mobile-phones security papers

Links for 2015-08-16

Links for 2015-08-12

Links for 2015-08-11

  • Reddit comments from a nuclear-power expert

    Reddit user "Hiddencamper" is a senior nuclear reactor operator in the US, and regularly posts very knowledgeable comments about reactor operations, safety procedures, and other details. It's fascinating (via Maciej)

    via:maciej nuclear-power nuclear atomic power energy safety procedures operations history chernobyl scram

  • Amazon EC2 2015 Benchmark: Testing Speeds Between AWS EC2 and S3 Regions

    Here we are again, a year later, and still no bloody percentiles! Just amateurish averaging. This is not how you measure anything, ffs. Still, better than nothing I suppose

    fail latency measurement aws ec2 percentiles s3

  • background doc on the Jeep hack

    "Remote Exploitation of an Unaltered Passenger Vehicle", by Dr. Charlie Miller (cmiller@openrce.org) and Chris Valasek (cvalasek@gmail.com). QNX, unauthenticated D-Bus, etc.

    'Since a vehicle can scan for other vulnerable vehicles and the exploit doesn't require any user interaction, it would be possible to write a worm. This worm would scan for vulnerable vehicles, exploit them with their payload which would scan for other vulnerable vehicles, etc. This is really interesting and scary. Please don't do this. Please.'

    jeep hacks exploits d-bus qnx cars safety risks

  • Care.data and access to UK health records: patient privacy and public trust

    'In 2013, the United Kingdom launched care.data, an NHS England initiative to combine patient records, stored in the machines of general practitioners (GPs), with information from social services and hospitals to make one centralized data archive. One aim of the initiative is to gain a picture of the care being delivered between different parts of the healthcare system and thus identify what is working in health care delivery, and what areas need greater attention and resources. This case study analyzes the complications around the launch of care.data. It explains the historical context of the program and the controversies that emerged in the course of the rollout. It explores problems in management and communications around the centralization effort, competing views on the safety of "anonymous" and "pseudonymous" health data, and the conflicting legal duties imposed on GPs with the introduction of the 2012 Health and Social Care Act. This paper also explores the power struggles in the battle over care.data and outlines the tensions among various stakeholders, including patients, GPs, the Health and Social Care Information Centre (HSCIC), the government, privacy experts and data purchasers. The predominant public policy question that emerges from this review centers on how best to utilize technological advances and simultaneously strike a balance between the many competing interests around health and personal privacy.'

    care.data privacy healthcare uk nhs trust anonymity anonymization gps medicine

Links for 2015-08-10

Links for 2015-08-07

Links for 2015-08-06

Links for 2015-08-05

Links for 2015-08-03

Links for 2015-07-30

Links for 2015-07-29

Links for 2015-07-28

  • Taming Complexity with Reversibility

    This is a great post from Kent Beck, putting a lot of recent deployment/rollout patterns in a clear context -- that of supporting "reversibility":

    Development servers. Each engineer has their own copy of the entire site. Engineers can make a change, see the consequences, and reverse the change in seconds without affecting anyone else. Code review. Engineers can propose a change, get feedback, and improve or abandon it in minutes or hours, all before affecting any people using Facebook. Internal usage. Engineers can make a change, get feedback from thousands of employees using the change, and roll it back in an hour. Staged rollout. We can begin deploying a change to a billion people and, if the metrics tank, take it back before problems affect most people using Facebook. Dynamic configuration. If an engineer has planned for it in the code, we can turn off an offending feature in production in seconds. Alternatively, we can dial features up and down in tiny increments (i.e. only 0.1% of people see the feature) to discover and avoid non-linear effects. Correlation. Our correlation tools let us easily see the unexpected consequences of features so we know to turn them off even when those consequences aren't obvious. IRC. We can roll out features potentially affecting our ability to communicate internally via Facebook because we have uncorrelated communication channels like IRC and phones. Right hand side units. We can add a little bit of functionality to the website and turn it on and off in seconds, all without interfering with people's primary interaction with NewsFeed. Shadow production. We can experiment with new services under real load, from a tiny trickle to the whole flood, without affecting production. Frequent pushes. Reversing some changes require a code change. On the website we never more than eight hours from the next schedule code push (minutes if a fix is urgent and you are willing to compensate Release Engineering). The time frame for code reversibility on the mobile applications is longer, but the downward trend is clear from six weeks to four to (currently) two. Data-informed decisions. (Thanks to Dave Cleal) Data-informed decisions are inherently reversible (with the exceptions noted below). "We expect this feature to affect this metric. If it doesn't, it's gone." Advance countries. We can roll a feature out to a whole country, generate accurate feedback, and roll it back without affecting most of the people using Facebook. Soft launches. When we roll out a feature or application with a minimum of fanfare it can be pulled back with a minimum of public attention. Double write/bulk migrate/double read. Even as fundamental a decision as storage format is reversible if we follow this format: start writing all new data to the new data store, migrate all the old data, then start reading from the new data store in parallel with the old.
    We do a bunch of these in work, and the rest are on the to-do list. +1 to these!

    software deployment complexity systems facebook reversibility dark-releases releases ops cd migration

Links for 2015-07-27

  • Benchmarking GitHub Enterprise - GitHub Engineering

    Walkthrough of debugging connection timeouts in a load test. Nice graphs (using matplotlib)

    github listen-backlog tcp debugging timeouts load-testing benchmarking testing ops linux

  • How .uk came to be (and why it's not .gb)

    WB: By the late 80s the IANA [the Internet Assigned Numbers Authority, set up in 1988 to manage global IP address allocations] was trying to get all those countries that were trying to join the internet to use the ISO 3166 standard for country codes. It was used for all sorts of things?—?you see it on cars, "GB" for the UK. [...] At that point, we're faced with a problem that Jon Postel would like to have changed it to .gb to be consistent with the rest of the world. Whereas .uk had already been established, with a few tens of thousands of domain names with .uk on them. I remember chairing one of the JANET net workshops that were held every year, and the Northern Irish were adamant that they were part of the UK?—?so the consensus was, we'd try and keep .uk, we'd park .gb and not use it. PK: I didn't particularly want to change to .gb because I was responsible for Northern Ireland as well. And what's more, there was a certain question as to whether a research group in the US should be allowed to tell the British what to do. So this argy-bargy continued for a little while and, in the meantime, one of my clients was the Ministry of Defence, and they decided they couldn't wait this long, and they decided I was going to lose the battle, and so bits of MOD went over to .gb?—?I didn't care, as I was running .gb and .uk in any case.

    dot-uk history internet dot-gb britain uk northern-ireland ireland janet

  • That time the Internet sent a SWAT team to my mom's house - Boing Boing

    The solution is for social media sites and the police to take threats or jokes about swatting, doxxing, and organized crime seriously. Tweeting about buying a gun and shooting up a school would be taken seriously, and so should the threat of raping, doxxing, swatting or killing someone. Privacy issues and online harassment are directly linked, and online harassment isn't going anywhere. My fear is that, in reaction to online harassment, laws will be passed that will break down our civil freedoms and rights online, and that more surveillance will be sold to users under the guise of safety. More surveillance, however, would not have helped me or my mother. A platform that takes harassment and threats seriously instead of treating them like jokes would have.

    twitter gamergate 4chan 8chan privacy doxxing swatting harrassment threats social-media facebook law feminism

  • Why Google's Deep Dream Is Future Kitsch

    Deep Dream estranges us from our fears, perhaps, but it doesn't make them go away. It's easy to discuss Deep Dream as an independent creature, a foreign intelligence that we interact with for fun. Yet like all kitsch, it comes straight back to its creators.

    kitsch deep-dream art graphics google inceptionism

  • It's Not Climate Change?—?It's Everything Change

    now this is a Long Read. the inimitable Margaret Atwood on climate change, beautifully illustrated

    climate climate-change margaret-atwood long-reads change life earth green future

  • In Praise of the AK-47 — Dear Design Student — Medium

    While someone can certainly make the case that an AK-47, or any other kind of gun or rifle is designed, nothing whose primary purpose is to take away life can be said to be designed well. And that attempting to separate an object from its function in order to appreciate it for purely aesthetic reasons, or to be impressed by its minimal elegance, is a coward's way of justifying the death they've designed into the word, and the money with which they're lining their pockets.

    design ux ak-47 kalashnikov guns function work

Links for 2015-07-22

Links for 2015-07-21

  • Java lambdas and performance

    Lambdas in Java 8 introduce some unpredictable performance implications, due to reliance on escape analysis to eliminate object allocation on every lambda invocation. Peter Lawrey has some details

    lambdas java-8 java performance low-latency optimization peter-lawrey coding escape-analysis

  • Mikhail Panchenko's thoughts on the July 2015 CircleCI outage

    an excellent followup operational post on CircleCI's "database is not a queue" outage

    database-is-not-a-queue mysql sql databases ops outages postmortems

  • Men who harass women online are quite literally losers, new study finds

    (1) players are anonymous, and the possibility of "policing individual behavior is almost impossible"; (2) they only encounter each other a few times in passing — it's very possible to hurl an expletive at another player, and never "see" him or her again; and (3) finally, and perhaps predictably, the sex-ratio of players is biased pretty heavily toward men. (A 2014 survey of gender ratios on Reddit found that r/halo was over 95 percent male.) [....] In each of these environments, Kasumovic suggests, a recent influx of female participants has disrupted a pre-existing social hierarchy. That's okay for the guys at the top — but for the guys at the bottom, who stand to lose more status, that's very threatening. (It's also in keeping with the evolutionary framework on anti-lady hostility, which suggests sexism is a kind of Neanderthal defense mechanism for low-status, non-dominant men trying to maintain a shaky grip on their particular cave's supply of women.) "As men often rely on aggression to maintain their dominant social status," Kasumovic writes, "the increase in hostility towards a woman by lower-status males may be an attempt to disregard a female's performance and suppress her disturbance on the hierarchy to retain their social rank."

    losers sexism mysogyny women halo gaming gamergate 4chan abuse harrassment papers bullying social-status

  • The old suburban office park is the new American ghost town - The Washington Post

    Most analyses of the market indicate that office parks simply aren't as appealing or profitable as they were in the 20th century and that Americans just aren't as keen to cloister themselves in workspaces that are reachable only by car.

    cbd cities work life office-parks commuting america history workplaces

  • HACKERS REMOTELY KILL A JEEP ON THE HIGHWAY—WITH ME IN IT

    Jaysus, this is terrifying.

    Miller and Valasek's full arsenal includes functions that at lower speeds fully kill the engine, abruptly engage the brakes, or disable them altogether. The most disturbing maneuver came when they cut the Jeep's brakes, leaving me frantically pumping the pedal as the 2-ton SUV slid uncontrollably into a ditch.
    Avoid any car which supports this staggeringly-badly-conceived Uconnect feature:
    All of this is possible only because Chrysler, like practically all carmakers, is doing its best to turn the modern automobile into a smartphone. Uconnect, an Internet-connected computer feature in hundreds of thousands of Fiat Chrysler cars, SUVs, and trucks, controls the vehicle's entertainment and navigation, enables phone calls, and even offers a Wi-Fi hot spot.
    :facepalm: Also, Chrysler's response sucks: "Chrysler's patch must be manually implemented via a USB stick or by a dealership mechanic."

    hacking security cars driving safety brakes jeeps chrysler fiat uconnect can-bus can

Links for 2015-07-20

Links for 2015-07-17

  • Angela Merkel told a sobbing girl she couldn't save her from deportation. It was a lie. - Vox

    Argentina has, as a matter of constitutional law, effectively open borders. There are no caps or quotas or lottery systems. You can move there legally if you have an employer or family member to sponsor you. That's all you need. If you don't have a sponsor, and make your way in illegally, you're recognized as an "irregular migrant." Discrimination against irregular migrants in health care or education is illegal, and deportation in noncriminal cases is exceptionally rare. Large-scale amnesties are the norm. Obviously Argentina is not nearly as rich as Germany or the US or the UK. But it's considerably richer than three of its neighbors (Bolivia, Paraguay, and Brazil). And yet it doesn't try hard to keep their residents out. It welcomes them — as it should. "One could have expected catastrophe—an uncontrollable flow of poorer immigrants streaming into the country coupled with angry public backlash," Elizabeth Slater writes in the World Policy Journal. "That hasn't happened." Angela Merkel clearly expects catastrophe if she lets people like this weeping young Palestinian girl stay in Germany. That catastrophe is simply a myth; it wouldn't happen. What would happen is that Germany's economy would grow, its culture would grow richer, and that girl and more like her could see their lives improve immeasurably.

    argentina immigration angela-merkel germany eu migrants deportation economics

Links for 2015-07-16

Links for 2015-07-15

Links for 2015-07-14

Links for 2015-07-13

  • OkHttp

    A new HTTP client library for Android and Java, with a lot of nice features:

    HTTP/2 and SPDY support allows all requests to the same host to share a socket. Connection pooling reduces request latency (if SPDY isn't available). Transparent GZIP shrinks download sizes. Response caching avoids the network completely for repeat requests. OkHttp perseveres when the network is troublesome: it will silently recover from common connection problems. If your service has multiple IP addresses OkHttp will attempt alternate addresses if the first connect fails. This is necessary for IPv4+IPv6 and for services hosted in redundant data centers. OkHttp initiates new connections with modern TLS features (SNI, ALPN), and falls back to TLS 1.0 if the handshake fails. Using OkHttp is easy. Its 2.0 API is designed with fluent builders and immutability. It supports both synchronous blocking calls and async calls with callbacks.

    android http java libraries okhttp http2 spdy microservices jdk

  • Eircode tech specs

    via Ossian.

    via:smytho tech-specs specs eircode addresses geocoding ireland mapping

  • AWS Best Practices for DDoS Resiliency [pdf]

    Reasonably solid white paper

    ddos amazon aws security dos whitepapers pdf

Links for 2015-07-11

Links for 2015-06-25

Links for 2015-06-23

Links for 2015-06-22

Links for 2015-06-21

  • jwz on Inceptionism

    "Shoggoth ovipositors":

    So then they reach inside to one of the layers and spin the knob randomly to fuck it up. Lower layers are edges and curves. Higher layers are faces, eyes and shoggoth ovipositors. [....] But the best part is not when they just glitch an image -- which is a fun kind of embossing at one end, and the "extra eyes" filter at the other -- but is when they take a net trained on some particular set of objects and feed it static, then zoom in, and feed the output back in repeatedly. That's when you converge upon the platonic ideal of those objects, which -- it turns out -- tend to be Giger nightmare landscapes. Who knew. (I knew.)
    This stuff is still boggling my mind. All those doggy faces! That is one dog-obsessed ANN.

    neural-networks ai jwz funny shoggoths image-recognition hr-giger art inceptionism

Links for 2015-06-19

Links for 2015-06-18

  • Inceptionism: Going Deeper into Neural Networks

    This is amazing, and a little scary.

    If we choose higher-level layers, which identify more sophisticated features in images, complex features or even whole objects tend to emerge. Again, we just start with an existing image and give it to our neural net. We ask the network: "Whatever you see there, I want more of it!" This creates a feedback loop: if a cloud looks a little bit like a bird, the network will make it look more like a bird. This in turn will make the network recognize the bird even more strongly on the next pass and so forth, until a highly detailed bird appears, seemingly out of nowhere.
    An enlightening comment from the G+ thread:
    This is the most fun we've had in the office in a while. We've even made some of those 'Inceptionistic' art pieces into giant posters. Beyond the eye candy, there is actually something deeply interesting in this line of work: neural networks have a bad reputation for being strange black boxes that that are opaque to inspection. I have never understood those charges: any other model (GMM, SVM, Random Forests) of any sufficient complexity for a real task is completely opaque for very fundamental reasons: their non-linear structure makes it hard to project back the function they represent into their input space and make sense of it. Not so with backprop, as this blog post shows eloquently: you can query the model and ask what it believes it is seeing or 'wants' to see simply by following gradients. This 'guided hallucination' technique is very powerful and the gorgeous visualizations it generates are very evocative of what's really going on in the network.?

    art machine-learning algorithm inceptionism research google neural-networks learning dreams feedback graphics

Links for 2015-06-17

Links for 2015-06-15

  • How We Moved Our API From Ruby to Go and Saved Our Sanity

    Parse on their ditching-Rails story. I haven't heard a nice thing about Ruby or Rails as an operational, production-quality platform in a long time :(

    go ruby rails ops parse languages platforms

  • VPC Flow Logs

    we are introducing Flow Logs for the Amazon Virtual Private Cloud.  Once enabled for a particular VPC, VPC subnet, or Elastic Network Interface (ENI), relevant network traffic will be logged to CloudWatch Logs for storage and analysis by your own applications or third-party tools. You can create alarms that will fire if certain types of traffic are detected; you can also create metrics to help you to identify trends and patterns. The information captured includes information about allowed and denied traffic (based on security group and network ACL rules). It also includes source and destination IP addresses, ports, the IANA protocol number, packet and byte counts, a time interval during which the flow was observed, and an action (ACCEPT or REJECT).

    ec2 aws vpc logging tracing ops flow-logs network tcpdump packets packet-capture

  • Tim Hunt "jokes" about women scientists. Or not. (with image, tweets) · deborahblum · Storify

    '[Tim Hunt] said that while he meant to be ironic, he did think it was hard to collaborate with women because they are too emotional - that he was trying to be honest about the problems.' So much for the "nasty twitter took my jokes seriously" claims then.

    twitter science misogyny women tim-hunt deborah-blum journalism

  • Why I dislike systemd

    Good post, and hard to disagree.

    One of the "features" of systemd is that it allows you to boot a system without needing a shell at all. This seems like such a senseless manoeuvre that I can't help but think of it as a knee-jerk reaction to the perception of Too Much Shell in sysv init scripts. In exactly which universe is it reasonable to assume that you have a running D-Bus service (or kdbus) and a filesystem containing unit files, all the binaries they refer to, all the libraries they link against, and all the configuration files any of them reference, but that you lack that most ubiquitous of UNIX binaries, /bin/sh?

    history linux unix systemd bsd system-v init ops dbus

  • Adrian Colyer reviews the Twitter Heron paper

    ouch, really sounds like Storm didn't cut the muster. 'It's hard to imagine something more damaging to Apache Storm than this. Having read it through, I'm left with the impression that the paper might as well have been titled "Why Storm Sucks", which coming from Twitter themselves is quite a statement.' If I was to summarise the lessons learned, it sounds like: backpressure is required; and multi-tenant architectures suck.

    storm twitter heron big-data streaming realtime backpressure

Links for 2015-06-14

Links for 2015-06-13

  • China's Spies Hit the Blackmail Jackpot With Data on 4 Million Federal Workers

    The Daily Beast is scathing re the OPM hack:

    Here's where things start to get scary. Whoever has OPM's records knows an astonishing amount about millions of federal workers, members of the military, and security clearance holders. They can now target those Americans for recruitment or influence. After all, they know their vices, every last one—the gambling habit, the inability to pay bills on time, the spats with former spouses, the taste for something sexual on the side—since all that is recorded in security clearance paperwork. (To get an idea of how detailed this gets, you can see the form, called an SF86, here.) Speaking as a former counterintelligence officer, it really doesn't get much worse than this.

    daily-beast sf86 clearance us-government america china cyberwar hacking opm privacy

Links for 2015-06-11

  • Facebook Infer

    New static analysis goodnews, freshly open-sourced by Facebook:

    Facebook Infer uses logic to do reasoning about a program's execution, but reasoning at this scale — for large applications built from millions of lines of source code — is hard. Theoretically, the number of possibilities that need to be checked is more than the number of estimated atoms in the observable universe. Furthermore, at Facebook our code is not a fixed artifact but an evolving system, updated frequently and concurrently by many developers. It is not unusual to see more than a thousand modifications to our mobile code submitted for review in a given day. The requirements on the program analyzer then become even more challenging because we expect a tool to report quickly on these code modifications — in the region of 10 minutes — to fit in with developers' workflow. Coping with this scale and velocity requires advanced mathematical techniques. Facebook Infer uses two such techniques: separation logic and bi-abduction. Separation logic is a theory that allows Facebook Infer's analysis to reason about small, independent parts of the application storage, rather than having to consider the entirety of the memory potentially at every step. That would be a daunting task on modern processors with their large addressable virtual memories. Bi-abduction is a logical inference technique that allows Facebook Infer to discover properties about the behavior of independent parts of the application code. By storing these properties between runs, Facebook Infer needs to analyze only the parts of the software that have changed, reusing the results of its previous analysis where it can. By combining these approaches, our analyzer is able to find complex problems in modifications to an application built from millions of lines of code, in minutes.
    (via Bryan O'Sullivan)

    via:bos infer facebook static-analysis lint code java ios android coding bugs

  • The Tamborzão Goes to Thailand

    This is great. the story of how cheesy funk carioca tune "A Minha Amiga Fran" managed to become "Kawo Kawo" and become a massive hit in Thailand

    thai brazil carioca music dance-music kawo-kawo

Links for 2015-06-10

Links for 2015-06-08

Links for 2015-06-04

Links for 2015-06-03

  • Performance Testing at LMAX

    Good series of blog posts on the LMAX trading platform's performance testing strategy -- they capture live traffic off the wire, then build statistical models simulating its features. See also http://epickrram.blogspot.co.uk/2014/07/performance-testing-at-lmax-part-two.html and http://epickrram.blogspot.co.uk/2014/08/performance-testing-at-lmax-part-three.html .

    performance testing tests simulation latency lmax trading sniffing packet-capture

  • The Violence of Algorithms: Why Big Data Is Only as Smart as Those Who Generate It

    The modern state system is built on a bargain between governments and citizens. States provide collective social goods, and in turn, via a system of norms, institutions, regulations, and ethics to hold this power accountable, citizens give states legitimacy. This bargain created order and stability out of what was an increasingly chaotic global system. If algorithms represent a new ungoverned space, a hidden and potentially ever-evolving unknowable public good, then they are an affront to our democratic system, one that requires transparency and accountability in order to function. A node of power that exists outside of these bounds is a threat to the notion of collective governance itself. This, at its core, is a profoundly undemocratic notion—one that states will have to engage with seriously if they are going to remain relevant and legitimate to their digital citizenry who give them their power.

    palantir algorithms big-data government democracy transparency accountability analytics surveillance war privacy protest rights

Links for 2015-06-02

Links for 2015-05-29

Links for 2015-05-28

  • I Fooled Millions Into Thinking Chocolate Helps Weight Loss

    "Slim by Chocolate!" the headlines blared. A team of German researchers had found that people on a low-carb diet lost weight 10 percent faster if they ate a chocolate bar every day. It made the front page of Bild, Europe's largest daily newspaper, just beneath their update about the Germanwings crash. From there, it ricocheted around the internet and beyond, making news in more than 20 countries and half a dozen languages. It was discussed on television news shows. It appeared in glossy print, most recently in the June issue of Shape magazine ("Why You Must Eat Chocolate Daily", page 128). Not only does chocolate accelerate weight loss, the study found, but it leads to healthier cholesterol levels and overall increased well-being. The Bild story quotes the study's lead author, Johannes Bohannon, Ph.D., research director of the Institute of Diet and Health: "The best part is you can buy chocolate everywhere." I am Johannes Bohannon, Ph.D. Well, actually my name is John, and I'm a journalist. I do have a Ph.D., but it's in the molecular biology of bacteria, not humans. The Institute of Diet and Health? That's nothing more than a website. Other than those fibs, the study was 100 percent authentic. My colleagues and I recruited actual human subjects in Germany. We ran an actual clinical trial, with subjects randomly assigned to different diet regimes. And the statistically significant benefits of chocolate that we reported are based on the actual data. It was, in fact, a fairly typical study for the field of diet research. Which is to say: It was terrible science. The results are meaningless, and the health claims that the media blasted out to millions of people around the world are utterly unfounded.
    Interesting bit: the online commenters commenting on the published stories quickly saw through the bullshit. Why can't the churnalising journos do that?

    chocolate journalism science diet food churnalism pr bild health clinical-trials papers peer-review research

  • Snake-Oil Superfoods

    mainly interesting for the dataviz and the Google-Doc-driven backend. wish they published the script though

    google snake-oil superfoods food dataviz bubble-race-chart graphics infographics google-docs spreadsheets

Links for 2015-05-27

  • Three Questions to Answer When Reporting an Error

    Very long, but tl;dr:

    the trick to creating an effective error message is to answer the 3 Questions within your message: What is the error? What was the probable cause of the error? What is the probable remedy?

    errors ui ux reporting logging coding

  • Volvo says horrible 'self-parking car accident' happened because driver didn't have 'pedestrian detection'

    Grim meathook future, courtesy of Volvo:

    "The Volvo XC60 comes with City Safety as a standard feature however this does not include the Pedestrian detection functionality [...] The pedestrian detection feature [...] costs approximately $3,000.
    However, there's another lesson here, in crappy car UX and the risks thereof:
    But even if it did have the feature, Larsson says the driver would have interfered with it by the way they were driving and "accelerating heavily towards the people in the video." "The pedestrian detection would likely have been inactivated due to the driver inactivating it by intentionally and actively accelerating," said Larsson. "Hence, the auto braking function is overrided by the driver and deactivated." Meanwhile, the people in the video seem to ignore their instincts and trust that the car assumed to be endowed with artificial intelligence knows not to hurt them. It is a sign of our incredible faith in the power of technology, but also, it's a reminder that companies making AI-assisted vehicles need to make safety features standard and communicate clearly when they aren't.

    self-driving-cars cars ai pedestrian computer-vision volvo fail accidents grim-meathook-future

  • iPhone UTF-8 text vulnerability

    'Due to how the banner notifications process the Unicode text. The banner briefly attempts to present the incoming text and then "gives up" thus the crash'. Apparently the entire Springboard launcher crashes.

    apple vulnerability iphone utf-8 unicode fail bugs springboard ios via:abetson

Links for 2015-05-26

  • Schedule Recurring AWS Lambda Invocations With The Unreliable Town Clock (UTC)

    The Unreliable Town Clock (UTC) is a new, free, public SNS Topic (Amazon Simple Notification Service) that broadcasts a "chime" message every quarter hour to all subscribers. It can send the chimes to AWS Lambda functions, SQS queues, and email addresses. You can use the chime attributes to run your code every fifteen minutes, or only run your code once an hour (e.g., when minute == "00") or once a day (e.g., when hour == "00" and minute == "00") or any other series of intervals. You can even subscribe a function you only want to run only once at a specific time in the future: Have the function ignore all invocations until it's after the time it wants. When it is time, it can perform its job, then unsubscribe itself from the SNS Topic.

    alestic aws lambda cron time clock periodic-tasks recurrence hacks

Links for 2015-05-25

Links for 2015-05-18

Links for 2015-05-17

  • 'Can People Distinguish Pâté from Dog Food?'

    Ugh.

    Considering the similarity of its ingredients, canned dog food could be a suitable and inexpensive substitute for pâté or processed blended meat products such as Spam or liverwurst. However, the social stigma associated with the human consumption of pet food makes an unbiased comparison challenging. To prevent bias, Newman's Own dog food was prepared with a food processor to have the texture and appearance of a liver mousse. In a double-blind test, subjects were presented with five unlabeled blended meat products, one of which was the prepared dog food. After ranking the samples on the basis of taste, subjects were challenged to identify which of the five was dog food. Although 72% of subjects ranked the dog food as the worst of the five samples in terms of taste (Newell and MacFarlane multiple comparison, P<0.05), subjects were not better than random at correctly identifying the dog food.

    pate food omgwtf science research dog-food meat economics taste flavour

  • Redditor runs the secret Python code in Ex Machina

    and finds:

    when you run with python2.7 you get the following: ISBN = 9780199226559 Which is Embodiment and the inner life: Cognition and Consciousness in the Space of Possible Minds. and so now I have a lot more respect for the Director.

    python movies ex-machina cool books easter-eggs

  • Metalwoman beer recipe

    via the Dublin Ladies Beer Society ;)

    metalman metalwoman recipes beer brewing hops dlbs

Links for 2015-05-14

Links for 2015-05-12

  • Input: Fonts for Code

    Non-monospaced coding fonts! I'm all in favour...

    As writing and managing code becomes more complex, today's sophisticated coding environments are evolving to include everything from breakpoint markers to code folding and syntax highlighting. The typography of code should evolve as well, to explore possibilities beyond one font style, one size, and one character width.

    input fonts via:its typography code coding font text ide monospace

  • Apache HTrace

    a Zipkin-compatible distributed-system tracing framework in Java, in the Apache Incubator

    zipkin tracing trace apache incubator java debugging

  • Intel speeds up etcd throughput using ADR Xeon-only hardware feature

    To reduce the latency impact of storing to disk, Weaver's team looked to buffering as a means to absorb the writes and sync them to disk periodically, rather than for each entry. Tradeoffs? They knew memory buffers would help, but there would be potential difficulties with smaller clusters if they violated the stable storage requirement. Instead, they turned to Intel's silicon architects about features available in the Xeon line. After describing the core problem, they found out this had been solved in other areas with ADR. After some work to prove out a Linux OS supported use for this, they were confident they had a best-of-both-worlds angle. And it worked. As Weaver detailed in his CoreOS Fest discussion, the response time proved stable. ADR can grab a section of memory, persist it to disk and power it back. It can return entries back to disk and restore back to the buffer. ADR provides the ability to make small (<100MB) segments of memory "stable" enough for Raft log entries. It means it does not need battery-backed memory. It can be orchestrated using Linux or Windows OS libraries. ADR allows the capability to define target memory and determine where to recover. It can also be exposed directly into libs for runtimes like Golang. And it uses silicon features that are accessible on current Intel servers.

    kubernetes coreos adr performance intel raft etcd hardware linux persistence disk storage xeon

Links for 2015-05-11

  • streamtools: a graphical tool for working with streams of data | nytlabs

    Visual programming, Yahoo! Pipes style, back again:

    we have created streamtools – a new, open source project by The New York Times R&D Lab which provides a general purpose, graphical tool for dealing with streams of data. It provides a vocabulary of operations that can be connected together to create live data processing systems without the need for programming or complicated infrastructure. These systems are assembled using a visual interface that affords both immediate understanding and live manipulation of the system.
    via Aman

    via:akohli streaming data nytimes visual-programming coding

  • MappedBus

    a Java based low latency, high throughput message bus, built on top of a memory mapped file; inspired by Java Chronicle with the main difference that it's designed to efficiently support multiple writers – enabling use cases where the order of messages produced by multiple processes are important. MappedBus can be also described as an efficient IPC mechanism which enable several Java programs to communicate by exchanging messages.

    ipc java jvm mappedbus low-latency mmap message-bus data-structures queue message-passing

Links for 2015-05-10

  • Amazon's Drone Delivery Patent Just Feels Like Trolling At This Point

    Oh dear, Amazon.

    These aren't actual technologies yet. [...] All of which underscores that Amazon might never ever ever ever actually implement delivery drones. The patent paperwork was filed nearly a year after Amazon's splashy drone program reveal on 60 Minutes. At the time we called it revolutionary marketing because, you know, delivery drones are technical and logistical madness, not to mention that commercial drone use is illegal right now. Although, in fairness the FAA did just relax some rules so that Amazon could test drones. At this point it feels like Amazon is just trolling. It's trolling us with public relations BS about its future drones, and it's trolling future competitors -- Google is also apparently working on this -- so that if somebody ever somehow does anything relating to drone delivery, Amazon can sue them. If I'm wrong, I'll deliver my apology via Airmail.

    amazon trolling patents uspto delivery drones uavs competition faa

  • Red Hat on rkt vs Docker

    This is like watching a train-wreck in slow motion on Groundhog Day. We, in the broader Linux and open source community, have been down this path multiple times over the past fifteen years, specifically with package formats. While there needs to be room for experimentation, having two incompatible specs driven by two startups trying to differentiate and in direct competition is *not* a good thing. It would be better for the community and for everyone who depends on our collective efforts if CoreOS and Docker collaborated on a standardized common spec, image format, and distribution protocol. To this end, we at Red Hat will continue to contribute to both initiatives with the goal of driving convergence.

    rkt docker appc coreos red-hat dpkg rpm linux packaging collaboration open-source

Links for 2015-05-09

Links for 2015-05-08

Links for 2015-05-07

  • KillBiller

    Excellent mobile-phone plan comparison site for the Irish market, using apps which you install and which analyse your call history, data usage, etc. over the past month to compute the optimal plan based on your usage. Pretty amazing results in my case! The only downside is the privacy policy, which allows the company to resell your usage data (anonymised, and in aggregate) -- I'd really prefer if this wasn't the case :(

    mobile-phones shopping tesco emobile 3g 4g ireland plans comparison-shopping killbiller via:its

  • Family in No poster Says YES to Marriage Equality | Amnesty International

    Beyond the politics, the risks of stock photo usage are pretty evident too:

    "In 2014, as a young family, we did a photo shoot with a photographer friend to get some nice shots for the family album. No money was exchanged – we got nice photos for free, they got nice images for their portfolio. As part of this agreement, we agreed to let them upload them to a stock photo album. We knew that these were available for purchase and we gave permission. Perhaps, naïvely, we imagined that on the off chance that any was ever selected, it might be for a small magazine or website. To confirm, we have not received any money for the photo – then or now, and nor do we expect any. We were surprised and upset to see that the photo was being used as part of a campaign with which we do not agree. We completely support same-sex marriage, and we believe that same-sex couples' should of course be able to adopt, as we believe that they are equally able to provide children with much-needed love and care. To suggest otherwise is offensive to us, and to many others."

    ssm ireland politics amnesty stock-photos ip rights photos campaigns ads

  • Lambda: Bees with Frickin' Laser Beams

    a HTTP testing tool in AWS Lambda. nice enough, but still a toy...

    lambda aws node javascript hacks http load-testing

Links for 2015-05-06

Links for 2015-05-05

  • Smarter testing Java code with Spock Framework

    hmm, looks quite nice as a potential next-gen JUnit replacement for unit tests

    java testing bdd tests junit unit-tests spock via:trishagee

  • Tots To Travel

    'Baby Friendly Holidays | Child, Toddler & Family Villas | France | Spain | Portugal | Italy'. Joe swears by it, will give it a go next year

    holidays vacation travel europe kids children via:joe

  • How the NSA Converts Spoken Words Into Searchable Text - The Intercept

    This hits the nail on the head, IMO:

    To Phillip Rogaway, a professor of computer science at the University of California, Davis, keyword-search is probably the "least of our problems." In an email to The Intercept, Rogaway warned that "When the NSA identifies someone as 'interesting' based on contemporary NLP methods, it might be that there is no human-understandable explanation as to why beyond: 'his corpus of discourse resembles those of others whom we thought interesting'; or the conceptual opposite: 'his discourse looks or sounds different from most people's.' If the algorithms NSA computers use to identify threats are too complex for humans to understand, it will be impossible to understand the contours of the surveillance apparatus by which one is judged.  All that people will be able to do is to try your best to behave just like everyone else."

    privacy security gchq nsa surveillance machine-learning liberty future speech nlp pattern-analysis cs

  • awslabs/aws-lambda-redshift-loader

    Load data into Redshift from S3 buckets using a pre-canned Lambda function. Looks like it may be a good example of production-quality Lambda

    lambda aws ec2 redshift s3 loaders etl pipeline

  • Call me maybe: Aerospike

    'Aerospike offers phenomenal latencies and throughput -- but in terms of data safety, its strongest guarantees are similar to Cassandra or Riak in Last-Write-Wins mode. It may be a safe store for immutable data, but updates to a record can be silently discarded in the event of network disruption. Because Aerospike's timeouts are so aggressive–on the order of milliseconds -- even small network hiccups are sufficient to trigger data loss. If you are an Aerospike user, you should not expect "immediate", "read-committed", or "ACID consistency"; their marketing material quietly assumes you have a magical network, and I assure you this is not the case. It's certainly not true in cloud environments, and even well-managed physical datacenters can experience horrible network failures.'

    aerospike outages cap testing jepsen aphyr databases storage reliability

Links for 2015-05-04

Links for 2015-05-02

  • In the privacy of your own home

    I didn't know about this:

    Last spring, as 41,000 runners made their way through the streets of Dublin in the city's Women's Mini Marathon, an unassuming redheaded man by the name of Candid Wueest stood on the sidelines with a scanner. He had built it in a couple of hours with $75 worth of parts, and he was using it to surreptitiously pick up data from activity trackers worn on the runners' wrists. During the race, Wueest managed to collect personal info from 563 racers, including their names, addresses, and passwords, as well as the unique IDs of the devices they were carrying.

    dublin candid-wueest privacy data marathon running iot activity-trackers

Links for 2015-04-30

Links for 2015-04-29

  • s3.amazonaws.com "certificate verification failed" errors due to crappy Verisign certs and overzealous curl policies

    Seth Vargo is correct. Its not the bit length of the key which is at issue, its the signature algorithm. The entire keychain for the s3.awsamazon.com key is signed with SHA1withRSA: https://www.ssllabs.com/ssltest/analyze.html?d=s3.amazonaws.com&s=54.231.244.0&hideResults=on At issue is that the root verisign key has been marked as weak because of SHA1 and taken out of the curl bundle which is widely popular, and this issue will continue to cause more and more issues going forwards as that bundle makes it way into shipping o/s distributions and aws certification verification breaks.
    'This is still happening and curl is now failing on my machine causing all sorts of fun issues (including breaking CocoaPods that are using S3 for storage).' -- @jmhodges This may be a contributory factor to the issue @nelson saw: https://nelsonslog.wordpress.com/2015/04/28/cyberduck-is-responsible-for-my-bad-ssl-certificate/ Curl's ca-certs bundle is also used by Node: https://github.com/joyent/node/issues/8894 and doubtless many other apps and packages. Here's a mailing list thread discussing the issue: http://curl.haxx.se/mail/archive-2014-10/0066.html -- looks like the curl team aren't too bothered about it.

    curl s3 amazon aws ssl tls certs sha1 rsa key-length security cacerts

  • Cassandra moving to using G1 as the default recommended GC implementation

    This is a big indicator that G1 is ready for primetime. CMS has long been the go-to GC for production usage, but requires careful, complex hand-tuning -- if G1 is getting to a stage where it's just a case of giving it enough RAM, that'd be great. Also, looks like it'll be the JDK9 default: https://twitter.com/shipilev/status/593175793255219200

    cassandra tuning ops g1gc cms gc java jvm production performance memory

  • The Colossal Shop

    ThisIsColossal now have a shop! bookmarking for some lovely gifts

    art design shop colossal shopping christmas gifts

Links for 2015-04-28

Links for 2015-04-27

Links for 2015-04-26

  • StackShare

    'Discover and discuss the best dev tools and cloud infrastructure services' -- fun!

    stackshare architecture stack ops software ranking open-source

  • OWASP KeyBox

    a web-based SSH console that centrally manages administrative access to systems. Web-based administration is combined with management and distribution of user's public SSH keys. Key management and administration is based on profiles assigned to defined users. Administrators can login using two-factor authentication with FreeOTP or Google Authenticator . From there they can create and manage public SSH keys or connect to their assigned systems through a web-shell. Commands can be shared across shells to make patching easier and eliminate redundant command execution.

    keybox owasp security ssh tls ssl ops

  • 32-bit overflow in BitGo js code caused an accidental 85 BTC transaction fee

    Yes, this is a fucking 32-bit integer overflow. Whatever software was used, it calculated the sum of all inputs using 32-bit variables, which overflow at about 20 BTC if signed or 40 BTC if not. The fee was supposed to be 0xC350 = 50,000 satoshis, but it turned out to be 0x2,0000,C350 = 8,589,984,592 satoshis. Captains of the industry. If they were captains of any other industry, like say for example automotive, we'd have people dying in car crashes between two stationary vehicles.

    bitcoin fail bitgo javascript bugs 32-bit overflow btc

  • Eight Docker Development Patterns

    good Docker tips

    tips docker ops deployment

  • Google Online Security Blog: A Javascript-based DDoS Attack [the Greatfire DDoS] as seen by Safe Browsing

    We hope this report helps to round out the overall facts known about this attack. It also demonstrates that collectively there is a lot of visibility into what happens on the web. At the HTTP level seen by Safe Browsing, we cannot confidently attribute this attack to anyone. However, it makes it clear that hiding such attacks from detailed analysis after the fact is difficult. Had the entire web already moved to encrypted traffic via TLS, such an injection attack would not have been possible. This provides further motivation for transitioning the web to encrypted and integrity-protected communication. Unfortunately, defending against such an attack is not easy for website operators. In this case, the attack Javascript requests web resources sequentially and slowing down responses might have helped with reducing the overall attack traffic. Another hope is that the external visibility of this attack will serve as a deterrent in the future.
    Via Nelson.

    google security via:nelson ddos javascript tls ssl safe-browsing networking china greatfire

Links for 2015-04-24

Links for 2015-04-23

  • attacks using U+202E - RIGHT-TO-LEFT OVERRIDE

    Security implications of in-band signalling strikes again, 43 years after the "Blue Box" hit the mainstream. Jamie McCarthy on Twitter: ".@cmdrtaco - Remember when we had to block the U+202E code point in Slashdot comments to stop siht ekil stnemmoc? https://t.co/TcHxKkx9Oo" See also http://krebsonsecurity.com/2011/09/right-to-left-override-aids-email-attacks/ -- GMail was vulnerable too; and http://en.wikipedia.org/wiki/Unicode_control_characters for more inline control chars. http://unicode.org/reports/tr36/#Bidirectional_Text_Spoofing has some official recommendations from the Unicode consortium on dealing with bidi override chars.

    security attacks rlo unicode control-characters codepoints bidi text gmail slashdot sanitization input

  • Meet the e-voting machine so easy to hack, it will take your breath away | Ars Technica

    The AVS WinVote system -- mind-bogglingly shitty security.

    If an election was held using the AVS WinVote, and it wasn't hacked, it was only because no one tried. The vulnerabilities were so severe, and so trivial to exploit, that anyone with even a modicum of training could have succeeded. They didn't need to be in the polling place—within a few hundred feet (e.g., in the parking lot) is easy, and within a half mile with a rudimentary antenna built using a Pringles can. Further, there are no logs or other records that would indicate if such a thing ever happened, so if an election was hacked any time in the past, we will never know. I've been in the security field for 30 years, and it takes a lot to surprise me. But the VITA report really shocked me—as bad as I thought the problems were likely to be, VITA's five-page report showed that they were far worse. And the WinVote system was so fragile that it hardly took any effort. While the report does not state how much effort went into the investigation, my estimation based on the description is that it was less than a person week.

    security voting via:johnke winvote avs shoup wep wifi windows

Links for 2015-04-22

  • 'Continuous Deployment: The Dirty Details'

    Good slide deck from Etsy's Mike Brittain regarding their CD setup. Some interesting little-known details: Slide 41: database schema changes are not CD'd -- they go out on "Schema change Thursdays". Slide 44: only the webapp is CD'd -- PHP, Apache, memcache components (Etsy.com, support and back-office tools, developer API, gearman async worker queues). The external "services" are not -- databases, Solr/JVM search (rolling restarts), photo storage (filters, proxy cache, S3), payments (PCI-DSS, controlled access). They avoid schema changes and breaking changes using an approach they call "non-breaking expansions" -- expose new version in a service interface; support multiple versions in the consumer. Example from slides 50-63, based around a database schema migration. Slide 66: "dev flags" (rollout oriented) are promoted to "feature flags" (long lived degradation control). Slide 71: some architectural philosophies: deploying is cheap; releasing is cheap; gathering data should be cheap too; treat first iterations as experiments. Slide 102: "Canary pools". They have multiple pools of users for testing in production -- the staff pool, users who have opted in to see prototypes/beta stuff, 0-100% gradual phased rollout.

    cd deploy etsy slides migrations database schema ops ci version-control feature-flags

  • Etsy's Release Management process

    Good info on how Etsy use their Deployinator tool, end-to-end. Slide 11: git SHA is visible for each env, allowing easy verification of what code is deployed. Slide 14: Code is deployed to "princess" staging env while CI tests are running; no need to wait for unit/CI tests to complete. Slide 23: smoke tests of pre-prod "princess" (complete after 8 mins elapsed). Slide 31: dashboard link for deployed code is posted during deploy; post-release prod smoke tests are run by Jenkins. (short ones! they complete in 42 seconds)

    deployment etsy deploy deployinator princess staging ops testing devops smoke-tests production jenkins

  • Makerbot's Saddest Hour | TechCrunch

    I've been speaking to a few people [at Makerbot] who prefer to remain anonymous and most of my contacts there are gone (the head of PR was apparently fired) and don't want to talk. But the new from inside is troubling. The mass-layoffs are blamed on low revenue and one former employee wrote "Company was failing. Couldn't pay vendors, had to downsize." Do I think Makerbot will sink? At this point I don't know.

    makerbot 3d-printing startups downsizing layoffs ouch

  • credstash

    'CredStash is a very simple, easy to use credential management and distribution system that uses AWS Key Management System (KMS) for key wrapping and master-key storage, and DynamoDB for credential storage and sharing.'

    aws credstash python security keys key-management secrets kms

  • ferd.ca -> Lessons Learned while Working on Large-Scale Server Software

    Good advice

    distributed scalability systems coding server-side erlang devops networking reliability

Links for 2015-04-20

  • FBI admits flaws in hair analysis over decades

    Wow, this is staggering.

    The Justice Department and FBI have formally acknowledged that nearly every examiner in an elite FBI forensic unit gave flawed testimony in almost all trials in which they offered evidence against criminal defendants over more than a two-decade period before 2000. [....] The review confirmed that FBI experts systematically testified to the near-certainty of "matches" of crime-scene hairs to defendants, backing their claims by citing incomplete or misleading statistics drawn from their case work. In reality, there is no accepted research on how often hair from different people may appear the same. Since 2000, the lab has used visual hair comparison to rule out someone as a possible source of hair or in combination with more accurate DNA testing. Warnings about the problem have been mounting. In 2002, the FBI reported that its own DNA testing found that examiners reported false hair matches more than 11 percent of the time.

    fbi false-positives hair dna biometrics trials justice experts crime forensics inaccuracy csi

  • The missing MtGox bitcoins

    Most or all of the missing bitcoins were stolen straight out of the MtGox hot wallet over time, beginning in late 2011. As a result, MtGox operated at fractional reserve for years (knowingly or not), and was practically depleted of bitcoins by 2013. A significant number of stolen bitcoins were deposited onto various exchanges, including MtGox itself, and probably sold for cash (which at the bitcoin prices of the day would have been substantially less than the hundreds of millions of dollars they were worth at the time of MtGox's collapse). MtGox' bitcoins continuously went missing over time, but at a decreasing pace. Again by the middle of 2013, the curve goes more or less flat, matching the hypothesis that by that time there may not have been any more bitcoins left to lose. The rate of loss otherwise seems unusually smooth and at the same time not strictly relative to any readily available factors such as remaining BTC holdings, transaction volumes or the BTC price. Worth pointing out is that, thanks to having matched up most of the deposit/withdrawal log earlier, we can at this point at least rule out the possibility of any large-scale fake deposits — the bitcoins going into MtGox were real, meaning the discrepancy was likely rather caused by bitcoins leaving MtGox without going through valid withdrawals.

    mtgox bitcoin security fail currency theft crime btc

  • Bank of the Underworld - The Atlantic

    Prosecutors analyzed approximately 500 of Liberty Reserve's biggest accounts, which constituted 44 percent of its business. The government contends that 32 of these accounts were connected to the sale of stolen credit cards and 117 were used by Ponzi-scheme operators. All of this activity flourished, prosecutors said, because Liberty Reserve made no real effort to monitor its users for criminal behavior. What's more, records showed that one of the company's top tech experts, Mark Marmilev, who was also arrested, appeared to have promoted Liberty Reserve in chat rooms devoted to Ponzi schemes.
    (via Nelson)

    scams fraud crime currency the-atlantic liberty-reserve ponzi-schemes costa-rica arthur-budovsky banking anonymity cryptocurrency money-laundering carding

  • I was a Lampedusa refugee. Here's my story of fleeing Libya – and surviving

    'The boy next to me fell to the floor and for a moment I didn't know if he had fainted or was dead – then I saw that he was covering his eyes so he didn't have to see the waves any more. A pregnant woman vomited and started screaming. Below deck, people were shouting that they couldn't breathe, so the men in charge of the boat went down and started beating them. By the time we saw a rescue helicopter, two days after our boat had left Libya with 250 passengers on board, some people were already dead – flung into the sea by the waves, or suffocated downstairs in the dark.'

    lampedusa migration asylum europe fortress-europe italy politics immigration libya refugees

  • Run your own high-end cloud gaming service on EC2

    Using Steam streaming and EC2 g2.2xlarge spot instances -- 'comes out to around $0.52/hr'. That's pretty compelling IMO

    aws ec2 gaming games graphics spot-instances hacks windows steam

  • Running Arbitrary Executables in AWS Lambda

    actually an officially-supported mode. huh

    lambda aws architecture ops node.js javascript unix linux

Links for 2015-04-18

Links for 2015-04-17

Links for 2015-04-16

  • Extracting Structured Data From Recipes Using Conditional Random Fields

    nice probabilistic/ML approach to recipe parsing

    nytimes recipes parsing text nlp machine-learning probabilistic crf++ algorithms feature-extraction

  • Large-scale cluster management at Google with Borg

    Google's Borg system is a cluster manager that runs hundreds of thousands of jobs, from many thousands of different applications, across a number of clusters each with up to tens of thousands of machines. It achieves high utilization by combining admission control, efficient task-packing, over-commitment, and machine sharing with process-level performance isolation. It supports high-availability applications with runtime features that minimize fault-recovery time, and scheduling policies that reduce the probability of correlated failures. Borg simplifies life for its users by offering a declarative job specification language, name service integration, real-time job monitoring, and tools to analyze and simulate system behavior. We present a summary of the Borg system architecture and features, important design decisions, a quantitative analysis of some of its policy decisions, and a qualitative examination of lessons learned from a decade of operational experience with it.
    (via Conall)

    via:conall clustering google papers scale to-read borg cluster-management deployment packing reliability redundancy

  • Keeping Your Car Safe From Electronic Thieves - NYTimes.com

    In a normal scenario, when you walk up to a car with a keyless entry and try the door handle, the car wirelessly calls out for your key so you don't have to press any buttons to get inside. If the key calls back, the door unlocks. But the keyless system is capable of searching for a key only within a couple of feet. Mr. Danev said that when the teenage girl turned on her device, it amplified the distance that the car can search, which then allowed my car to talk to my key, which happened to be sitting about 50 feet away, on the kitchen counter. And just like that, open sesame.
    What the hell -- who designed a system that would auto-unlock based on signal strength alone?!!

    security fail cars keys signal proximity keyless-entry prius toyota crime amplification power-amplifiers 3db keyless

  • Closed access means people die

    'We've paid 100 BILLION USD over the last 10 years to "publish" science and medicine. Ebola is a massive systems failure.' See also https://www.techdirt.com/articles/20150409/17514230608/dont-think-open-access-is-important-it-might-have-prevented-much-ebola-outbreak.shtml : 'The conventional wisdom among public health authorities is that the Ebola virus, which killed at least 10,000 people in Liberia, Sierra Leone and Guinea, was a new phenomenon, not seen in West Africa before 2013. [...] But, as the team discovered, that "conventional wisdom" was wrong. In fact, they found a bunch of studies, buried behind research paywalls, that revealed that there was significant evidence of antibodies to the Ebola virus in Liberia and in other nearby nations. There was one from 1982 that noted: "medical personnel in Liberian health centers should be aware of the possibility that they may come across active cases and thus be prepared to avoid nosocomial epidemics."

    deaths liberia ebola open-access papers elsevier science medicine reprints

  • Making Pinterest — Learn to stop using shiny new things and love MySQL

    'The third reason people go for shiny is because older tech isn't advertised as aggressively as newer tech. The younger companies needs to differentiate from the old guard and be bolder, more passionate and promise to fulfill your wildest dreams. But most new tech sales pitches aren't generally forthright about their many failure modes. In our early days, we fell into this third trap. We had a lot of growing pains as we scaled the architecture. The most vocal and excited database companies kept coming to us saying they'd solve all of our scalability problems. But nobody told us of the virtues of MySQL, probably because MySQL just works, and people know about it.' It's true! -- I'm still a happy MySQL user for some use cases, particularly read-mostly relational configuration data...

    mysql storage databases reliability pinterest architecture

  • Microservices and elastic resource pools with Amazon EC2 Container Service

    interesting approach to working around ECS' shortcomings -- bit specific to Hailo's microservices arch and IPC mechanism though. aside: I like their version numbering scheme: ISO-8601, YYYYMMDDHHMMSS. keep it simple!

    versioning microservices hailo aws ec2 ecs docker containers scheduling allocation deployment provisioning qos

  • Please Kill Me (Eventually) | Motherboard

    There is much that the wise application of technology can do to help us ease off this mortal coil, instead of tormenting ourselves at the natural end of life in a futile, undignified and excruciating attempt to keep it somehow duct-taped on. Train more people in geriatrics, for example. Learn new ways to make life safe, healthy, fun and interesting for the old. Think like a community, a brotherhood, not like atomized competing individuals a few of whom can somehow "beat the system" of the universe. Maybe it is better to examine clearly what we are with a view to understanding and acceptance than it is to try to escape what perhaps should be our inevitable ending.

    death mortality cryogenics alcor geriatrics life singularity mind-uploading ray-kurzweil

  • CGA in 1024 Colors - a New Mode: the Illustrated Guide

    awesome hackery. brings me back to my C=64 demo days

    pc cga graphics hacks art 1024-colours

Links for 2015-04-15

  • Keywhiz

    'a secret management and distribution service [from Square] that is now available for everyone. Keywhiz helps us with infrastructure secrets, including TLS certificates and keys, GPG keyrings, symmetric keys, database credentials, API tokens, and SSH keys for external services — and even some non-secrets like TLS trust stores. Automation with Keywhiz allows us to seamlessly distribute and generate the necessary secrets for our services, which provides a consistent and secure environment, and ultimately helps us ship faster. [...] Keywhiz has been extremely useful to Square. It's supported both widespread internal use of cryptography and a dynamic microservice architecture. Initially, Keywhiz use decoupled many amalgamations of configuration from secret content, which made secrets more secure and configuration more accessible. Over time, improvements have led to engineers not even realizing Keywhiz is there. It just works. Please check it out.'

    square security ops keys pki key-distribution key-rotation fuse linux deployment secrets keywhiz

Links for 2015-04-14

Links for 2015-04-13

  • Amazon Machine Learning

    Upsides of this new AWS service: * great UI and visualisations. * solid choice of metric to evaluate the results. Maybe things moved on since I was working on it, but the use of AUC, false positives and false negatives was pretty new when I was working on it. (er, 10 years ago!) Downsides: * it could do with more support for unsupervised learning algorithms. Supervised learning means you need to provide training data, which in itself can be hard work. My experience with logistic regression in the past is that it requires very accurate training data, too -- its tolerance for misclassified training examples is poor. * Also, in my experience, 80% of the hard work of using ML algorithms is writing good tokenisation and feature extraction algorithms. I don't see any help for that here unfortunately. (probably not that surprising as it requires really detailed knowledge of the input data to know what classes can be abbreviated into a single class, etc.)

    amazon aws ml machine-learning auc data-science

  • Rob Pike's 5 rules of optimization

    these are great. I've run into rule #3 ("fancy algorithms are slow when n is small, and n is usually small") several times...

    twitter rob-pike via:igrigorik coding rules laws optimization performance algorithms data-structures aphorisms

  • AWS Lambda Event-Driven Architecture With Amazon SNS

    Any message posted to an SNS topic can trigger the execution of custom code you have written, but you don't have to maintain any infrastructure to keep that code available to listen for those events and you don't have to pay for any infrastructure when the code is not being run. This is, in my opinion, the first time that Amazon can truly say that AWS Lambda is event-driven, as we now have a central, independent, event management system (SNS) where any authorized entity can trigger the event (post a message to a topic) and any authorized AWS Lambda function can listen for the event, and neither has to know about the other.

    aws ec2 lambda sns events cep event-processing coding cloud hacks eric-hammond

  • Texting at the wheel kills more US teenagers every year than drink-driving

    Texting while behind the wheel has overtaken drink driving as the biggest cause of death among teenagers in America. More than 3,000 teenagers are killed every year in car crashes caused by texting while driving compared to 2,700 from drink driving. The study by Cohen Children's Medical Center also discovered that 50 per cent of students admit to texting while driving.

    texting sms us driving car-safety safety drink-driving

  • China's Great Cannon

    Conducting such a widespread attack clearly demonstrates the weaponization of the Chinese Internet to co-opt arbitrary computers across the web and outside of China to achieve China's policy ends.  The repurposing of the devices of unwitting users in foreign jurisdictions for covert attacks in the interests of one country's national priorities is a dangerous precedent — contrary to international norms and in violation of widespread domestic laws prohibiting the unauthorized use of computing and networked systems.

    censorship ddos internet security china great-cannon citizen-lab reports web

  • Sirius: An open end-to-end voice and vision personal assistant and its implications for future warehouse scale computers

    How to build an Intelligent Personal Assistant: 'Sirius is an open end-to-end standalone speech and vision based intelligent personal assistant (IPA) similar to Apple's Siri, Google's Google Now, Microsoft's Cortana, and Amazon's Echo. Sirius implements the core functionalities of an IPA including speech recognition, image matching, natural language processing and a question-and-answer system. Sirius is developed by Clarity Lab at the University of Michigan. Sirius is published at the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) 2015.'

    sirius siri cortana google-now echo ok-google ipa assistants search video audio speech papers clarity nlp wikipedia

  • Why We Will Not Be Registering easyDNS.SUCKS - blog.easydns.org

    If you're not immersed in the naming business you may find the jargon in it hard to understand. The basic upshot is this: the IPC believes that the mechanisms that were enacted to protect trademark holders during the deluge of new TLD rollouts are being gamed by the .SUCKS TLD operator to extort inflated fees from trademark holders.
    (via Nelson)

    shakedown business internet domains dns easydns dot-sucks scams tlds trademarks ip

Links for 2015-04-12

Links for 2015-04-11

Links for 2015-04-10

  • Hacked French network exposed its own passwords during TV interview

    lols

    passwords post-its fail tv5monde authentication security tv funny

  • RADStack - an open source Lambda Architecture built on Druid, Kafka and Samza

    'In this paper we presented the RADStack, a collection of complementary technologies that can be used together to power interactive analytic applications. The key pieces of the stack are Kafka, Samza, Hadoop, and Druid. Druid is designed for exploratory analytics and is optimized for low latency data exploration, aggregation, and ingestion, and is well suited for OLAP workflows. Samza and Hadoop complement Druid and add data processing functionality, and Kafka enables high throughput event delivery.'

    druid samza kafka streaming cep lambda-architecture architecture hadoop big-data olap

  • outbrain/gruffalo

    an asynchronous Netty based graphite proxy. It protects Graphite from the herds of clients by minimizing context switches and interrupts; by batching and aggregating metrics. Gruffalo also allows you to replicate metrics between Graphite installations for DR scenarios, for example. Gruffalo can easily handle a massive amount of traffic, and thus increase your metrics delivery system availability. At Outbrain, we currently handle over 1700 concurrent connections, and over 2M metrics per minute per instance.

    graphite backpressure metrics outbrain netty proxies gruffalo ops

  • Privacy Security Talk in TOG – 22nd April @ 7pm – FREE

    Dublin is lucky enough to have great speakers pass through town on occasion and on Wednesday the 22nd April 2015, Runa A. Sandvik (@runasand) and Per Thorsheim (@thorsheim) have kindly offered to speak in TOG from 7pm. The format for the evening is a general meet and greet, but both speakers have offered to give a presentation on a topic of their choice. Anyone one interested in privacy, security, journalism, Tor and/or has previously attended a CryptoParty would be wise to attend. Doors are from 7pm and bring any projects with you you would like to share with other attendees. This is a free event, open to the public and no need to book. See you Wednesday. Runa A. Sandvik is an independent privacy and security researcher, working at the intersection of technology, law and policy. She contributes to The Tor Project, writes for Forbes, and is a technical advisor to both the Freedom of the Press Foundation and the TrueCrypt Audit project. Per Thorsheim as founder/organizer of PasswordsCon.org, his topic of choice is of course passwords, but in a much bigger context than most people imagine. Passwords, pins, biometrics, 2-factor authentication, security/usability and all the way into surveillance and protecting your health, kids and life itself.

    privacy security runa-sandvik per-thorsheim passwords tor truecrypt tog via:oisin events dublin

Links for 2015-04-09

Links for 2015-04-08

Links for 2015-04-07

Links for 2015-04-06

Links for 2015-04-03

  • Twitter's new anti-harassment filter

    Twitter is calling it a "quality filter," and it's been rolling out to verified users running Twitter's iOS app since last week. It appears to work much like a spam filter, except instead of hiding bots and copy-paste marketers, it screens "threats, offensive language, [and] duplicate content" out of your notifications feed.
    via Nelson

    via:nelson harassment spam twitter gamergame abuse ml

  • 5% of Google visitors have ad-injecting malware installed

    Ad injectors were detected on all operating systems (Mac and Windows), and web browsers (Chrome, Firefox, IE) that were included in our test. More than 5% of people visiting Google sites have at least one ad injector installed. Within that group, half have at least two injectors installed and nearly one-third have at least four installed.
    via Nelson.

    via:nelson ads google chrome ad-injectors malware scummy

  • On Ruby

    The horrors of monkey-patching:

    I call out the Honeybadger gem specifically because was the most recent time I'd been bit by a seemingly good thing promoted in the community: monkey patching third party code. Now I don't fault Honeybadger for making their product this way. It provides their customers with direct business value: "just require 'honeybadger' and you're done!" I don't agree with this sort of practice. [....] I distrust everything [in Ruby] but a small set of libraries I've personally vetted or are authored by people I respect. Why is this important? Without a certain level of scrutiny you will introduce odd and hard to reproduce bugs. This is especially important because Ruby offers you absolutely zero guarantee whatever the state your program is when a given method is dispatched. Constants are not constants. Methods can be redefined at run time. Someone could have written a time sensitive monkey patch to randomly undefined methods from anything in ObjectSpace because they can. This example is so horribly bad that no one should every do, but the programming language allows this. Much worse, this code be arbitrarily inject by some transitive dependency (do you even know what yours are?).

    ruby monkey-patching coding reliability bugs dependencies libraries honeybadger sinatra

Links for 2015-04-02

Links for 2015-04-01

Links for 2015-03-31

Links for 2015-03-30

Links for 2015-03-26

Links for 2015-03-25

Links for 2015-03-24

Links for 2015-03-23

Links for 2015-03-22

Links for 2015-03-19

  • Stairs to nowhere, trap streets, and other Toronto oddities

    'There's a set of stairs on Greenwood Avenue that lead nowhere. At the top, a wooden fence at the end of someone's back yard blocks any further movement, forcing the climber to turn around and descend back to the street. What's remarkable about the pointless Greenwood stairs, which were built in 1959 as a shortcut to a now-demolished brickyard, is that someone still routinely maintains them: in winter, some kindly soul deposits a scattering of salt lest one of the stairs' phantom users slip; in summer someone comes with a broom to sweep away leaves. These urban leftovers are lovingly called "Thomassons" after Gary Thomasson, a former slugger for the San Francisco Giants, Oakland As, Yankees, Dodgers, and, most fatefully, the Yomiuri Giants in Tokyo.'

    trap-streets maps ip google via:bldgblog mapping copyright thomassons orphaned-roads

Links for 2015-03-18

  • President's message gets lost in (automated) translation

    In a series of bizarre translations, YouTube's automated translation service took artistic licence with the [President's] words of warmth. When the head of state sent St Patrick's Day greetings to viewers, the video sharing site said US comedian Tina Fey was being "particular with me head". As President Higgins spoke of his admiration for Irish emigrants starting new communities abroad, YouTube said the President referenced blackjack and how he "just couldn't put the new iPhone" down. And, in perhaps the most unusual moment, as he talked of people whose hearts have sympathy, the President "explained" he was once on a show "that will bar a gift card".
    (via Daragh O'Brien)

    lol president ireland michael-d-higgins automation translation machine-learning via:daraghobrien funny blackjack iphone tina-fey st-patrick fail

  • Irish government under fire for turning its back on basic research : Nature News & Comment

    Pretty much ALL of Ireland's research scientists have put their names to an open letter to the Irish government, decrying the state of science funding, published this week in "Nature". 'Although total spending on research and development grew through the recession, helped by foreign investments, Ireland's government has cut state spending on research (see 'Celtic tiger tamed'). It also prioritized grants in 14 narrow areas — ones in which either large global markets exist, or in which Irish companies are competitive. These include marine renewable energy, smart grids, medical devices and computing. The effect has been to asphyxiate the many areas of fundamental science — including astrophysics, particle physics and areas of the life sciences — that have been deprived of funding, several researchers in Ireland told Nature. "The current policies are having a very significant detrimental effect on the health and viability of the Irish scientific ecosystem," says Kevin Mitchell, a geneticist who studies the basis of neurological disorders at Trinity College Dublin. "Research that cannot be shoehorned into one of the 14 prioritized areas has been ineligible for most funding," he says.' That's another fine mess Sean Sherlock has gotten us into :(

    sean-sherlock fail ireland research government funding grants science tcd kevin-mitchell life-sciences nature

  • Mars One finalist Dr. Joseph Roche rips into the project

    So, here are the facts as we understand them: Mars One has almost no money. Mars One has no contracts with private aerospace suppliers who are building technology for future deep-space missions. Mars One has no TV production partner. Mars One has no publicly known investment partnerships with major brands. Mars One has no plans for a training facility where its candidates would prepare themselves. Mars One's candidates have been vetted by a single person, in a 10-minute Skype interview. "My nightmare about it is that people continue to support it and give it money and attention, and it then gets to the point where it inevitably falls on its face," said Roche. If, as a result, "people lose faith in NASA and possibly even in scientists, then that's the polar opposite of what I'm about. If I was somehow linked to something that could do damage to the public perception of science, that is my nightmare scenario."

    science space mars-one tcd joseph-roche nasa mars exploration scams

Links for 2015-03-17

Links for 2015-03-13

  • demonstration of the importance of server-side request timeouts

    from MongoDB, but similar issues often apply in many other TCP/HTTP-based systems

    tcp http requests timeout mongodb reliability safety

  • Heka

    an open source stream processing software system developed by Mozilla. Heka is a "Swiss Army Knife" type tool for data processing, useful for a wide variety of different tasks, such as: Loading and parsing log files from a file system. Accepting statsd type metrics data for aggregation and forwarding to upstream time series data stores such as graphite or InfluxDB. Launching external processes to gather operational data from the local system. Performing real time analysis, graphing, and anomaly detection on any data flowing through the Heka pipeline. Shipping data from one location to another via the use of an external transport (such as AMQP) or directly (via TCP). Delivering processed data to one or more persistent data stores.
    Via feylya on twitter. Looks potentially nifty

    heka mozilla monitoring metrics via:feylya ops statsd graphite stream-processing

Links for 2015-03-12

Links for 2015-03-11

Links for 2015-03-10

  • Epsilon Interactive breach the Fukushima of the Email Industry (CAUCE)

    Upon gaining access to an ESP, the criminals then steal subscriber data (PII such as names, addresses, telephone numbers and email addresses, and in one case, Vehicle Identification Numbers). They then use ESPs' mailing facility to send spam; to monetize their illicit acquisition, the criminals have spammed ads for fake Adobe Acrobat and Skype software. On March 30, the Epsilon Interactive division of Alliance Data Marketing (ADS on NASDAQ) suffered a massive breach that upped the ante, substantially.  Email lists of at least eight financial institutions were stolen.  Thus far, puzzlingly, Epsilon has refused to release the names  of compromised clients. [...] The obvious issue at hand is the ability of the thieves to now undertake targeted spear-phishing problem as critically serious as it could possibly be.

    cauce epsilon-interactive esp email pii data-protection spear-phishing phishing identity-theft security ads

  • In Ukraine, Tomorrow's Drone War Is Alive Today

    Drones, hackerspaces and crowdfunding:

    The most sophisticated UAV that has come out of the Ukrainian side since the start of the conflict is called the PD-1 from developer Igor Korolenko. It has a wingspan of nearly 10 feet, a five-hour flight time, carries electro-optical and infrared sensors as well as a video camera that broadcasts on a 128 bit encrypted channel. Its most important feature is the autopilot software that allows the drone to return home in the event that the global positioning system link is jammed or lost. Drone-based intelligence gathering is often depicted as risk-free compared to manned aircraft or human intelligence gathering, but, says Korolenko, if the drone isn't secure or the signature is too obvious, the human coasts can be very, very high. "Russian military sometimes track locations of ground control stations," he wrote Defense One in an email. "Therefore UAV squads have to follow certain security measures - to relocate frequently, to move out antennas and work from shelter, etc. As far as I know, two members of UAV squads were killed from mortar attacks after [their] positions were tracked by Russian electronic warfare equipment."
    (via bldgblog)

    via:bldgblog war drones uav future ukraine russia tech aircraft pd-1 crowdfunding

  • Javascript Acid Machine

    a 303 and an 808 in your browser. this is deadly

    acid 303 music javascript hacks via:hn techno

Links for 2015-03-09

  • Ubuntu To Officially Switch To systemd Next Monday - Slashdot

    Jesus. This is going to be the biggest shitfest in the history of Linux...

    linux slashdot ubuntu systemd init unix ops

  • uselessd

    A project to reduce systemd to a base initd, process supervisor and transactional dependency system, while minimizing intrusiveness and isolationism. Basically, it's systemd with the superfluous stuff cut out, a (relatively) coherent idea of what it wants to be, support for non-glibc platforms and an approach that aims to minimize complicated design. uselessd is still in its early stages and it is not recommended for regular use or system integration.
    This may be the best option to evade the horrors of systemd.

    init linux systemd unix ops uselessd

  • Japan's Robot Dogs Get Funerals as Sony Looks Away

    in July 2014, [Sony's] repairs [of Aibo robot dogs] stopped and owners were left to look elsewhere for help. The Sony stiff has led not only to the formation of support groups--where Aibo enthusiasts can share tips and help each other with repairs--but has fed the bionic pet vet industry. "The people who have them feel their presence and personality," Nobuyuki Narimatsu, director of A-Fun, a repair company for robot dogs, told AFP. "So we think that somehow, they really have souls." While concerted repair efforts have kept many an Aibo alive, a shortage of spare parts means that some of their lives have come to an end.

    sony aibo robots japan dogs pets weird future badiotday iot gadgets

  • "Cuckoo Filter: Practically Better Than Bloom"

    'We propose a new data structure called the cuckoo filter that can replace Bloom filters for approximate set membership tests. Cuckoo filters support adding and removing items dynamically while achieving even higher performance than Bloom filters. For applications that store many items and target moderately low false positive rates, cuckoo filters have lower space overhead than space-optimized Bloom filters. Our experimental results also show that cuckoo filters outperform previous data structures that extend Bloom filters to support deletions substantially in both time and space.'

    algorithms paper bloom-filters cuckoo-filters cuckoo-hashing data-structures false-positives big-data probabilistic hashing set-membership approximation

  • Amazing cutting from Vanity Fair, 1896, for International Women's Day

    "The sisters make a pretty picture on the platform ; but it is not women of their type who need to assert themselves over Man. However, it amuses them--and others ; and I doubt if the tyrant has much to fear from their little arrows." Constance Markievicz was one of those sisters, and the other was Eva Gore-Booth.

    markievicz history ireland sligo vanity-fair 19th-century dismissal sexism iwd women

  • Anatomy of a Hack

    Authy doesn't come off well here: 'Authy should have been harder to break. It's an app, like Authenticator, and it never left Davis' phone. But Eve simply reset the app on her phone using a mail.com address and a new confirmation code, again sent by a voice call. A few minutes after 3AM, the Authy account moved under Eve's control.'

    authy security hacking mfa authentication google apps exploits

  • Ask the Decoder: Did I sign up for a global sleep study?

    How meaningful is this corporate data science, anyway? Given the tech-savvy people in the Bay Area, Jawbone likely had a very dense sample of Jawbone wearers to draw from for its Napa earthquake analysis. That allowed it to look at proximity to the epicenter of the earthquake from location information. Jawbone boasts its sample population of roughly "1 million Up wearers who track their sleep using Up by Jawbone." But when looking into patterns county by county in the U.S., Jawbone states, it takes certain statistical liberties to show granularity while accounting for places where there may not be many Jawbone users. So while Jawbone data can show us interesting things about sleep patterns across a very large population, we have to remember how selective that population is. Jawbone wearers are people who can afford a $129 wearable fitness gadget and the smartphone or computer to interact with the output from the device. Jawbone is sharing what it learns with the public, but think of all the public health interests or other third parties that might be interested in other research questions from a large scale data set. Yet this data is not collected with scientific processes and controls and is not treated with the rigor and scrutiny that a scientific study requires. Jawbone and other fitness trackers don't give us the option to use their devices while opting out of contributing to the anonymous data sets they publish. Maybe that ought to change.

    jawbone privacy data-protection anonymization aggregation data medicine health earthquakes statistics iot wearables

  • Pinterest's highly-available configuration service

    Stored on S3, update notifications pushed to clients via Zookeeper

    s3 zookeeper ha pinterest config storage

  • A Journey into Microservices | Hailo Tech Blog

    Excellent three-parter from Hailo, describing their RabbitMQ+Go-based microservices architecture. Very impressive!

    hailo go microservices rabbitmq amqp architecture blogs

  • soundcloud/lhm

    The Large Hadron Migrator is a tool to perform live database migrations in a Rails app without locking.

    The basic idea is to perform the migration online while the system is live, without locking the table. In contrast to OAK and the facebook tool, we only use a copy table and triggers. The Large Hadron is a test driven Ruby solution which can easily be dropped into an ActiveRecord or DataMapper migration. It presumes a single auto incremented numerical primary key called id as per the Rails convention. Unlike the twitter solution, it does not require the presence of an indexed updated_at column.

    migrations database sql ops mysql rails ruby lhm soundcloud activerecord

  • Biased Locking in HotSpot (David Dice's Weblog)

    This is pretty nuts. If biased locking in the HotSpot JVM is causing performance issues, it can be turned off:

    You can avoid biased locking on a per-object basis by calling System.identityHashCode(o). If the object is already biased, assigning an identity hashCode will result in revocation, otherwise, the assignment of a hashCode() will make the object ineligible for subsequent biased locking.

    hashcode jvm java biased-locking locking mutex synchronization locks performance

Links for 2015-03-07

  • A Zero-Administration Amazon Redshift Database Loader - AWS Big Data Blog

    nifty!

    lambda amazon aws redshift etl

  • Archie Markup Language (ArchieML)

    ArchieML (or "AML") was created at The New York Times to make it easier to write and edit structured text on deadline that could be rendered in web pages, or more specifically, rendered in interactive graphics. One of the main goals was to make it easy to tag text as data, without having type a lot of special characters. Another goal was to allow the document to contain lots of notes and draft text that would not be read into the data. And finally, because we make extensive use of Google Documents's concurrent-editing features — while working on a graphic, we can have several reporters, editors and developers all pouring information into a single document — we wanted to have a format that could survive being edited by users who may never have seen ArchieML or any other markup language at all before.

    aml archie markup text nytimes archieml writing

  • California Says Motorcycle Lane-Splitting Is Hella Safe

    A recent yearlong study by the California Office of Traffic Safety has found motorcycle lane-splitting to be a safe practice on public roads. The study looked at collisions involving 7836 motorcyclists reported by 80 police departments between August 2012 and August 2013. "What we learned is, if you lane-split in a safe or prudent manner, it is no more dangerous than motorcycling in any other circumstance," state spokesman Chris Cochran told the Sacramento Bee. "If you are speeding or have a wide speed differential (with other traffic), that is where the fatalities came about."

    lane-splitting cycling motorcycling bikes road-safety driving safety california

  • Try Server

    Good terminology for this concept:

    The try server runs a similar configuration to the continuous integration server, except that it is triggered not on commits but on "try job request", in order to test code pre-commit.
    See also https://wiki.mozilla.org/ReleaseEngineering/TryServer for the Moz take on it.

    build ci integration try-server jenkins buildbot chromium development

  • metrics-sql

    A Dropwizard Metrics extension to instrument JDBC resources and measure SQL execution times.

    metrics sql jdbc instrumentation dropwizard

  • HP is trying to patent Continuous Delivery

    This is appalling bollocks from HP:

    On 1st March 2015 I discovered that in 2012 HP had filed a patent (WO2014027990) with the USPO for 'Performance tests in a continuous deployment pipeline' (the patent was granted in 2014). [....] HP has filed several patents covering standard Continuous Delivery (CD) practices. You can help to have these patents revoked by providing 'prior art' examples on Stack Exchange.
    In fairness, though, this kind of shit happens in most big tech companies. This is what happens when you have a broken software patenting system, with big rewards for companies who obtain shitty troll patents like these, and in turn have companies who reward the engineers who sell themselves out to write up concepts which they know have prior art. Software patents are broken by design!

    cd devops hp continuous-deployment testing deployment performance patents swpats prior-art

Links for 2015-03-05

Links for 2015-03-04

Links for 2015-03-02

  • Glowroot

    "Open source APM for Java" -- profiling in production, with a demo benchmark showing about a 2% performance impact. Wonder about effects on memory/GC, though

    apm java metrics measurement new-relic profiling glowroot

  • "Everything you've ever said to Siri/Cortana has been recorded...and I get to listen to it"

    This should be a reminder.

    At first, I though these sound bites were completely random. Then I began to notice a pattern. Soon, I realized that I was hearing peoples commands given to their mobile devices. Guys, I'm telling you, if you've said it to your phone, it's been recorded...and there's a damn good chance a 3rd party is going to hear it.

    privacy google siri cortana android voice-recognition outsourcing mobile

  • Halcyon Days

    Fantastic 1997-era book of interviews with the programmers behind some of the greatest games in retrogaming history:

    Halcyon Days: Interviews with Classic Computer and Video Game Programmers was released as a commercial product in March 1997. At the time it was one of the first retrogaming projects to focus on lost history rather than game collecting, and certainly the first entirely devoted to the game authors themselves. Now a good number of the interviewees have their own web sites, but none of them did when I started contacting them in 1995. [...] If you have any of the giddy anticipation that I did whenever I picked up a magazine containing an interview with Mark Turmell or Dan [M.U.L.E.] Bunten, then you want to start reading.

    book games history coding interviews via:walter

  • Pub Table Quiz - In Aid of Digital Rights Ireland

    Jason Roe is organising a Table Quiz in Dublin on March 26th to support fundraising efforts by Digital Rights Ireland. We will supply tables, questions and a ready supply of beer and maybe finger food.

    dri pub-quiz fun dublin quizzes

  • Why are transhumanists such dicks?

    Good discussion from a transhumanist forum (via Boing Boing):

    "I've been around and interviewed quite a lot of self-identified transhumanists in the last couple of years, and I've noticed many of them express a fairly stark ideology that is at best libertarian, and at worst Randian. Very much "I want super bionic limbs and screw the rest of the world". They tend to brush aside the ethical, environmental, social and political ramifications of human augmentation so long as they get to have their toys. There's also a common expression that if sections of society are harmed by transhumanist progress, then it is unfortunate but necessary for the greater good (the greater good often being bestowed primarily upon those endorsing the transhumanism). That attitude isn't prevalent on this forum at all – I think the site tends to attract more practical body-modders than theoretical transhumanists – but I wondered if anyone else here had experienced the same attitudes in their own circles? What do you make of it?"

    transhumanism evolution body-modding surgery philosophy via:boingboing libertarianism society politics

Links for 2015-02-27

Links for 2015-02-26

  • JClarity's Illuminate

    Performance-diagnosis-as-a-service. Cool.

    Users download and install an Illuminate Daemon using a simple installer which starts up a small stand alone Java process. The Daemon sits quietly unless it is asked to start gathering SLA data and/or to trigger a diagnosis. Users can set SLA's via the dashboard and can opt to collect latency measurements of their transactions manually (using our library) or by asking Illuminate to automatically instrument their code (Servlet and JDBC based transactions are currently supported). SLA latency data for transactions is collected on a short cycle. When the moving average of latency measurements goes above the SLA value (e.g. 150ms), a diagnosis is triggered. The diagnosis is very quick, gathering key data from O/S, JVM(s), virtualisation and other areas of the system. The data is then run through the machine learned algorithm which will quickly narrow down the possible causes and gather a little extra data if needed. Once Illuminate has determined the root cause of the performance problem, the diagnosis report is sent back to the dashboard and an alert is sent to the user. That alert contains a link to the result of the diagnosis which the user can share with colleagues. Illuminate has all sorts of backoff strategies to ensure that users don't get too many alerts of the same type in rapid succession!

    illuminate jclarity java jvm scala latency gc tuning performance

  • grpc.io

    Binary message marshalling, client/server stubs generated by an IDL compiler, bidirectional binary protocol. CORBA is back from the dead! Intro blog post: http://googledevelopers.blogspot.ie/2015/02/introducing-grpc-new-open-source-http2.html Relevant: Steve Vinoski's commentary on protobuf-rpc back in 2008: http://steve.vinoski.net/blog/2008/07/13/protocol-buffers-leaky-rpc/

    http rpc http2 netty grpc google corba idl messaging

Links for 2015-02-25

Links for 2015-02-24

Links for 2015-02-23

Links for 2015-02-22

Links for 2015-02-20

  • 2015-02-19 GCE outage

    40 minutes of multi-zone network outage for majority of instances. 'The internal software system which programs GCE's virtual network for VM egress traffic stopped issuing updated routing information. The cause of this interruption is still under active investigation. Cached route information provided a defense in depth against missing updates, but GCE VM egress traffic started to be dropped as the cached routes expired.' I wonder if Google Pimms fired the alarms for this ;)

    google outages gce networking routing pimms multi-az cloud

  • Listen to a song made from data lost during MP3 conversion

    Ryan McGuire, a PhD student in Composition and Computer Technologies at the University of Virginia Center for Computer Music, has created the project The Ghost In The MP3 [....] For his first trick, McGuire took Suzanne Vega's 'Tom's Diner' and drained it into a vaporous piece titled 'moDernisT." McGuire chose the track he explains on his site because it was famously used as one of the main controls in the listening tests used to develop the MP3 algorithm.

    mp3 music suzanne-vega compression

Links for 2015-02-19

Links for 2015-02-18

Links for 2015-02-17

Links for 2015-02-16

Links for 2015-02-13

  • Slack's coming to Dublin

    Butterfield insists that Slack improves on the basic messaging functionality offered by its predecessors. The company plans to expand from 100 employees to 250 this year, open an office in Dublin, and launch a version that supports large companies with multiple teams.

    slack messaging chat dublin ireland jobs tech

  • yahoo/kafka-manager

    A tool for managing Apache Kafka. It supports the following : Manage multiple clusters; Easy inspection of cluster state (topics, brokers, replica distribution, partition distribution); Run preferred replica election; Generate partition assignments (based on current state of cluster); Run reassignment of partition (based on generated assignments)

    yahoo kafka ops tools

  • Vaurien, the Chaos TCP Proxy — Vaurien 1.8 documentation

    Vaurien is basically a Chaos Monkey for your TCP connections. Vaurien acts as a proxy between your application and any backend. You can use it in your functional tests or even on a real deployment through the command-line. Vaurien is a TCP proxy that simply reads data sent to it and pass it to a backend, and vice-versa. It has built-in protocols: TCP, HTTP, Redis & Memcache. The TCP protocol is the default one and just sucks data on both sides and pass it along. Having higher-level protocols is mandatory in some cases, when Vaurien needs to read a specific amount of data in the sockets, or when you need to be aware of the kind of response you're waiting for, and so on. Vaurien also has behaviors. A behavior is a class that's going to be invoked everytime Vaurien proxies a request. That's how you can impact the behavior of the proxy. For instance, adding a delay or degrading the response can be implemented in a behavior. Both protocols and behaviors are plugins, allowing you to extend Vaurien by adding new ones. Last (but not least), Vaurien provides a couple of APIs you can use to change the behavior of the proxy live. That's handy when you are doing functional tests against your server: you can for instance start to add big delays and see how your web application reacts.

    proxy tcp vaurien chaos-monkey testing functional-testing failures sockets redis memcache http

  • Embed-able Computers are a Thing. — February 12, 2015

    'If it works, a copy of Burgertime for DOS is now in your browser, clickable from my entry. If it doesn't… well, no Burgertime for you. (Unless you visit the page.) There's a "share this" link in the new archive.org interface for sharing these in-browser emulations in web pages, weblogs and who knows what else.'

    sharing embeds html javascript emulation msdos burgertime games archive.org

  • China's Internet Censors Now Have Their Own Theme Song, And It Is Glorious - China Real Time Report - WSJ

    According to a report posted Thursday to the website of the state-run China Youth Daily, the Cyberspace Administration of China choral group this week unveiled a new song, "Cyberspace Spirit," glorifying the cleanliness and clarity of China's uniquely managed Internet. The song, an orchestral march built around a chorus that proclaims China's ambition to become an "Internet power," opens with lyrics describing celestial bodies keeping careful watch over the sky. From there, the lyrics conjure more vivid imagery, comparing the Internet to "a beam of incorruptible sunlight" that unites "the powers of life from all creation."

    china great-firewall censorship music songs cyberspace-spirit omgwtfbbq

Links for 2015-02-12

Links for 2015-02-11

  • Automating Tinder with Eigenfaces

    While my friends were getting sucked into "swiping" all day on their phones with Tinder, I eventually got fed up and designed a piece of software that automates everything on Tinder.
    This is awesome. (via waxy)

    via:waxy tinder eigenfaces machine-learning k-nearest-neighbour algorithms automation ai

  • RateLimitedLogger

    Our latest open source release from Swrve Labs: an Apache-licensed, SLF4J-compatible, simple, fluent API for rate-limited logging in Java: 'A RateLimitedLog object tracks the rate of log message emission, imposes an internal rate limit, and will efficiently suppress logging if this is exceeded. When a log is suppressed, at the end of the limit period, another log message is output indicating how many log lines were suppressed. This style of rate limiting is the same as the one used by UNIX syslog; this means it should be comprehensible, easy to predict, and familiar to many users, unlike more complex adaptive rate limits.' We've been using this in production for months -- it's pretty nifty ;) Never fear your logs again!

    logs logging coding java open-source swrve slf4j rate-limiting libraries

Links for 2015-02-10

Links for 2015-02-06

Links for 2015-02-05

Links for 2015-02-03

Links for 2015-02-02

  • A Quiet Defense of Patterns

    Marc Brooker: 'When it comes to building working software in the long term, the emotional pursuit of craft is not as important as the human pursuit of teamwork, or the intellectual pursuit of correctness. Patterns is one of the most powerful ideas we have. The critics may be right that it devalues the craft, but we would all do well to remember that the craft of software is a means, not an end.'

    marc-brooker design-patterns coding software teamwork

  • One Hundred Miles of Solitude

    Via Walter, the best description of the appeal of Minecraft I've read:

    Minecraft is exceptionally good at intrinsic narrative. It recognises, preserves and rewards everything you do. It presses you to play frontiersman. A Minecraft world ends up dotted with torchlit paths, menhirs, landmarks, emergency caches. Here's the hole where you dug stone for your first house. Here's the causeway you built from your spawn point to a handy woodland. Here's the crater in the landscape where the exploding monster took out you and your wheatfield at once. And, of course, here's your enormous castle above a waterfall. There's no utility in building anything bigger than a hut, but the temptations of architecture are irresistible. Minecraft isn't so much a world generator as a screenshot-generator and a war-story generator. This is what will get the game the bulk of its critical attention, and deservedly so. That's why I want to call attention to the extrinsic narrative. It's minimal, implicit,  accidental and very powerful. It's this: you wake alone beside an endless sea in a pristine, infinite wilderness. The world is yours. You can literally sculpt mountains, with time and effort. You'll die and be reborn on the beach where you woke first. You'll walk across the world forever and never see another face. You can build a whole empire of roads and palaces and beacon towers, and the population of that empire will only ever be you. When you leave, your towers will stand empty forever. I haven't seen that surfaced in a game before. It's strong wine.

    minecraft narrative gaming games story

  • Backstage Blog - Prometheus: Monitoring at SoundCloud - SoundCloud Developers

    whoa, this is pretty excellent. The major improvement over a graphite-based system would be the multi-dimensional tagging of metrics, which we currently have to do by simply expanding the graphite metric's name to encompass all those dimensions and use searching at query time, inefficiently.

    monitoring soundcloud prometheus metrics service-metrics graphite alerting

  • 'Prometheus instrumentation library for JVM applications'

    Good example of a clean java OSS release, from Soundcloud. will be copying bits of this myself soon...

    prometheus java libraries oss github sonatype maven releases

  • Google Java Style

    A good set of basic, controversy-free guidelines for clean java code style

    style java google coding guidelines formatting coding-standards

  • A Brief History of NSA Backdoors

    from 1946 to present

    nsa security backdoors sigint actel dual_ec_drbg crypto-ag crypto

  • Study: You Can't Change an Anti-Vaxxer's Mind

    According to a major new study in the journal 'Pediatrics', trying to [persuade anti-vaxxers to vaccinate] may actually make the problem worse. The paper tested the effectiveness of four separate pro-vaccine messages, three of which were based very closely on how the Centers for Disease Control and Prevention (CDC) itself talks about vaccines. The results can only be called grim: Not a single one of the messages was successful when it came to increasing parents' professed intent to vaccinate their children. And in several cases the messages actually backfired, either increasing the ill-founded belief that vaccines cause autism or even, in one case, apparently reducing parents' intent to vaccinate.

    vaccination health measles mmr autism facts via:mrneutron stupidity cdc papers vaccines

  • Coining "Dysguria"

    "dysaguria" is the perfect noun, and "dysagurian" is the perfect adjective, to describe the eponymous company in Dave Eggers' The Circle. It's not in the same league as Orwell, or Huxley, or Bradbury, or Burgess. But it does raise very important questions about what could possibly go wrong if one company controlled all the world's information. In the novel, the company operates according to the motto "all that happens must be known"; and one of its bosses, Eamon Bailey, encourages everywoman employee Mae Holland to live an always-on (clear, transparent) life according the maxims "secrets are lies", "sharing is caring", and "privacy is theft". Eggers's debts to dystopian fiction are apparent. But, whereas writers like Orwell, Huxley, Bradbury, and Burgess were concerned with totalitarian states, Eggers is concerned with a totalitarian company. However, the noun "dystopia" and the adjective "dystopian" – perfect though they are for the terror of military/security authoritarianism in 1984, or Brave new World, or Farenheit 451, or A Clockwork Orange – do not to my mind encapsulate the nightmare of industrial/corporate tyranny in The Circle. On the other hand, "dysaguria" as a noun and "dysagurian" as an adjective, in my view really do capture the essence of that "frightening company".

    dysaguria dystopia future sf authoritarianism surveillance the-circle google facebook

  • A NetHack bot ascends!

    Via negatendo: 'I would like to share my excitement about the fact that after almost a year of development, an instance of my NetHack bot has finally managed to ascend a game for the first time without human interventions, wizard mode cheats or bones stuffing, and did so at the public server at acehack.de.' The bot is written in Clojure. Apparently 'pudding farming' did the trick...

    clojure via:negatendo pudding-farming games nethack bots

Links for 2015-01-30

  • H.P. Lovecat

    Because there exists no method known to man, more terribly suited to expose the cosmic meaningless of existence than pairing the words of H.P. Lovecraft with seemingly delightful and charming pictures of adorable kittens.

    lovecraft cthulhu horror funny kittens cats images gif

  • 8 gdb tricks you should know (Ksplice Blog)

    These are very good -- bookmarking for the next time I'm using gdb, probably about 3 years from now

    c debugging gdb c++ tips coding

  • EFF's Game Plan for Ending Global Mass Surveillance

    For years, we've been working on a strategy to end mass surveillance of digital communications of innocent people worldwide. Today we're laying out the plan, so you can understand how all the pieces fit together—that is, how U.S. advocacy and policy efforts connect to the international fight and vice versa. Decide for yourself where you can get involved to make the biggest difference. This plan isn't for the next two weeks or three months. It's a multi-year battle that may need to be revised many times as we better understand the tools and authorities of entities engaged in mass surveillance and as more disclosures by whistleblowers help shine light on surveillance abuses.

    eff privacy nsa surveillance gchq law policy us-politics

  • No POD

    This group aims to consolidate opposition, give clear information and support letter writing and information awareness against the Dept. of Education's Primary Online Database.

    pod ireland privacy data-protection children kids schools

  • Apple Pay suffering fraud problems

    Fraud in Apple Pay will in time, come to be managed – but the fact that easily available PII can waylay best in class protection should give us all pause.

    fraud apple apple-pay pii identity-theft

  • Excellent example of failed "anonymisation" of a dataset

    Fred Logue notes how this failed Mayo TD Michelle Mulherin:

    From recent reports it mow appears that the Department of Education is discussing anonymisation of the Primary Online Database with the Data Protection Commissioner. Well someone should ask Mayo TD Michelle Mulherin how anonymisation is working for her. The Sunday Times reports that Ms Mulherin was the only TD in the Irish parliament on the dates when expensive phone calls were made to a mobile number in Kenya. The details of the calls were released under the Freedom of Information Act in an "anonymised" database. While it must be said the fact that Ms Mulherin was the only TD present on those occasions does not prove she made the calls – the reporting in the press is now raising the possibility that it was her. From a data protection point of view this is a perfect example of the difficulty with anonymisation. Data protection rules apply to personal data which is defined as data relating to a living individual who is or can be identified from the data or from the data in conjunction with other information. Anonymisation is often cited as a means for processing data outside the scope of data protection law but as Ms Mulherin has discovered individuals can be identified using supposedly anonymised data when analysed in conjunction with other data. In the case of the mysterious calls to Kenya even though the released information was "anonymised" to protect the privacy of public representatives, the phone log used in combination with the attendance record of public representatives and information on social media was sufficient to identify individuals and at least raise evidence of association between individuals and certain phone calls. While this may be well and good in terms of accounting for abuses of the phone service it also has worrying implications for the ability of public representatives to conduct their business in private. The bottom line is that anonymisation is very difficult if not impossible as Ms Mulherin has learned to her cost. It certainly is a lot more complex than simply removing names and other identifying features from a single dataset. The more data that there is and the more diverse the sources the greater the risk that individuals can be identified from supposedly anonymised datasets.

    data anonymisation fred-logue ireland michelle-mulherin tds kenya data-protection privacy

Links for 2015-01-26

Links for 2015-01-25

Links for 2015-01-24

  • How to Catch a Terrorist - The New Yorker

    This is spot on --

    By flooding the system with false positives, big-data approaches to counterterrorism might actually make it harder to identify real terrorists before they act. Two years before the Boston Marathon bombing, Tamerlan Tsarnaev, the older of the two brothers alleged to have committed the attack, was assessed by the city's Joint Terrorism Task Force. They determined that he was not a threat. This was one of about a thousand assessments that the Boston J.T.T.F. conducted that year, a number that had nearly doubled in the previous two years, according to the Boston F.B.I. As of 2013, the Justice Department has trained nearly three hundred thousand law-enforcement officers in how to file "suspicious-activity reports." In 2010, a central database held about three thousand of these reports; by 2012 it had grown to almost twenty-eight thousand. "The bigger haystack makes it harder to find the needle," Sensenbrenner told me. Thomas Drake, a former N.S.A. executive and whistle-blower who has become one of the agency's most vocal critics, told me, "If you target everything, there's no target."

    terrorism false-positives filtering detection jttf nsa fbi surveillance gchq

  • Politwoops

    'All deleted tweets from politicians'. Great idea

    delete twitter politics politicians ireland social-media news

  • Zoë Keating on getting a shitty deal from Google's new Music Key licensing

    The Youtube music service was introduced to me as a win win and they don't understand why I don't see it that way. "We are trying to create a new revenue stream on top of the platform that exists today." A lot of people in the music industry talk about Google as evil. I don't think they are evil. I think they, like other tech companies, are just idealistic in a way that works best for them. I think this because I used to be one of them. The people who work at Google, Facebook, etc can't imagine how everything they make is not, like, totally awesome. If it's not awesome for you it's because you just don't understand it yet and you'll come around. They can't imagine scenarios outside their reality and that is how they inadvertently unleash things like the algorithmic cruelty of Facebook's yearly review (which showed me a picture I had posted after a doctor told me my husband had 6-8 weeks to live).

    google business music youtube zoe-keating music-key licensing tech

  • Smash the Engine

    Jacobin Magazine on the revolutionary political allegory in "Snowpiercer": 'If Snowpiercer had merely told the tale of an oppressed working class rising up to seize power from an evil overlord, it would already have been an improvement over most of the political messages in mainstream cinema. There are all sorts of nice touches in its portrayal of a declining capitalism that can maintain its ideological legitimacy even when it literally has no more bullets in its guns. But the story Bong tells goes beyond that. It's about the limitations of a revolution which merely takes over the existing social machinery rather than attempting to transcend it. '

    dystopia revolution snowpiercer movies marxism sf politics

  • Debunking The Dangerous "If You Have Nothing To Hide, You Have Nothing To Fear"

    A great resource bookmark from Falkvinge.

    There are at least four good reasons to reject this argument solidly and uncompromisingly: The rules may change, it's not you who determine if you're guilty, laws must be broken for society to progress, and privacy is a basic human need.

    nsa politics privacy security surveillance gchq rick-falkvinge society

Links for 2015-01-20

Links for 2015-01-19

  • carbon-c-relay

    A much better carbon-relay, written in C rather than Python. Linking as we've been using it in production for quite a while with no problems.

    The main reason to build a replacement is performance and configurability. Carbon is single threaded, and sending metrics to multiple consistent-hash clusters requires chaining of relays. This project provides a multithreaded relay which can address multiple targets and clusters for each and every metric based on pattern matches.

    graphite carbon c python ops metrics

  • Surveillance of social media not way to fight terrorism – Minister

    Blanket surveillance of social media is not the solution to combating terrorism and the rights of the individual to privacy must be protected, Data Protection Minister Dara Murphy said on Monday. [He] said Ireland and the European Union must protect the privacy rights of individuals on social media. "Freedom of expression, freedom of movement, and the protection of privacy are core tenets of the European Union, which must be upheld."

    dara-murphy data-protection privacy surveillance europe eu ireland social-media

Links for 2015-01-18

  • Amazing comment from a random sysadmin who's been targeted by the NSA

    'Here's a story for you. I'm not a party to any of this. I've done nothing wrong, I've never been suspected of doing anything wrong, and I don't know anyone who has done anything wrong. I don't even mean that in the sense of "I pissed off the wrong people but technically haven't been charged." I mean that I am a vanilla, average, 9-5 working man of no interest to anybody. My geographical location is an accident of my birth. Even still, I wasn't accidentally born in a high-conflict area, and my government is not at war. I'm a sysadmin at a legitimate ISP and my job is to keep the internet up and running smoothly. This agency has stalked me in my personal life, undermined my ability to trust my friends attempting to connect with me on LinkedIn, and infected my family's computer. They did this because they wanted to bypass legal channels and spy on a customer who pays for services from my employer. Wait, no, they wanted the ability to potentially spy on future customers. Actually, that is still not accurate - they wanted to spy on everybody in case there was a potentially bad person interacting with a customer. After seeing their complete disregard for anybody else, their immense resources, and their extremely sophisticated exploits and backdoors - knowing they will stop at nothing, and knowing that I was personally targeted - I'll be damned if I can ever trust any electronic device I own ever again. You all rationalize this by telling me that it "isn't surprising", and that I don't live in the [USA,UK] and therefore I have no rights. I just have one question. Are you people even human?'

    nsa via:ioerror privacy spying surveillance linkedin sysadmins gchq security

  • DRI's Unchanged Position on Eircode

    'Broadly, they are satisfied with what we are doing' versus: 'We have deep concerns about the Eircode initiative… We want to state clearly that we are not at all 'satisfied' with the postcode that has been designed or the implementation proposals.'

    dri ireland eircode postcodes privacy data-protection quotes misrepresentation

Links for 2015-01-17

  • Misogyny in the Valley

    The young women interns [in one story in this post] worked in a very different way. As I explored their notes, I noticed that ideas were expanded upon, not abandoned. Challenges were identified, but the male language so often heard in Silicon Valley conference rooms - "Well, let me tell you what the problem with that idea is…." - was not in the room.  These young women, without men to define the "appropriate business behavior," used different behaviors and came up with a startling and valuable solution. They showed many of the values that exist outside of dominance-based leadership: strategic thinking, intuition, nurturing and relationship building, values-based decision-making and acceptance of other's input. Women need space to be themselves at work. Until people who have created their success by worshipping at the temple of male behavior, like Sheryl Sandberg, learn to value alternate behaviors, the working world will remain a foreign and hostile culture to women. And if we do not continuously work to build corporate cultures where there is room for other behaviors, women will be cast from or abandoned in a world not of our making, where we continuously "just do not fit in," but where we still must go to earn our livings.

    sexism misogyny silicon-valley tech work sheryl-sandberg business collaboration

  • Are you better off running your big-data batch system off your laptop?

    Heh, nice trolling.

    Here are two helpful guidelines (for largely disjoint populations): If you are going to use a big data system for yourself, see if it is faster than your laptop. If you are going to build a big data system for others, see that it is faster than my laptop. [...] We think everyone should have to do this, because it leads to better systems and better research.

    graph coding hadoop spark giraph graph-processing hardware scalability big-data batch algorithms pagerank

  • BBC uses RIPA terrorism laws to catch TV licence fee dodgers in Northern Ireland

    Give them the power, they'll use that power. 'A document obtained under Freedom of Information legislation confirms the BBC's use of RIPA in Northern Ireland. It states: "The BBC may, in certain circumstances, authorise under the Regulation of Investigatory Powers Act 2000 and Regulation of Investigatory Powers (British Broadcasting Corporation) Order 2001 the lawful use of detection equipment to detect unlicensed use of television receivers... the BBC has used detection authorised under this legislation in Northern Ireland."'

    ripa privacy bbc tv license-fee uk northern-ireland law scope-creep

  • Australia tries to ban crypto research – by ACCIDENT • The Register

    Researchers are warned off [discussing] 512-bits-plus key lengths, systems "designed or modified to perform cryptanalytic functions, or "designed or modified to use 'quantum cryptography'". [....] "an email to a fellow academic could land you a 10 year prison sentence".
    https://twitter.com/_miw/status/556023024009224192 notes 'the DSGL 5A002 defines it as >512bit RSA, >512bit DH, >112 bit ECC and >56 bit symmetric ciphers; weak as fuck i say.'

    law australia crime crypto ecc rsa stupidity fail

Links for 2015-01-16

  • A Case Study of Toyota Unintended Acceleration and Software Safety

    I drive a Toyota, and this is scary stuff. Critical software systems need to be coded with care, and this isn't it -- they don't even have a bug tracking system!

    Investigations into potential causes of Unintended Acceleration (UA) for Toyota vehicles have made news several times in the past few years. Some blame has been placed on floor mats and sticky throttle pedals. But, a jury trial verdict was based on expert opinions that defects in Toyota's Electronic Throttle Control System (ETCS) software and safety architecture caused a fatal mishap.  This talk will outline key events in the still-ongoing Toyota UA litigation process, and pull together the technical issues that were discovered by NASA and other experts. The results paint a picture that should inform future designers of safety critical software in automobiles and other systems.

    toyota safety realtime coding etcs throttle-control nasa code-review embedded

Links for 2015-01-15

  • Group warns of postcode project dangers | Irish Examiner

    "We have spoken to the National Consumer Agency, logistics companies and Digital Rights Ireland, with which we have had an indepth conversation to see if there is anything in the proposal that might be considered to have an impact on anyone's privacy. Broadly, they are satisfied with what we are doing," [Patricia Cronin, head of the Department of Communications' postcodes division] told the committee. However in his letter, [DRI's] O'Lachtnain said the group "want to state clearly that we are not at all 'satisfied' with the postcode that has been designed or the implementation proposals".
    Some nerve!

    dri nca privacy patricia-cronin goverment postcodes eircode dpc ireland

Links for 2015-01-14

  • Of Course 23andMe's Plan Has Been to Sell Your Genetic Data All Along

    Today, 23andMe announced what Forbes reports is only the first of ten deals with big biotech companies: Genentech will pay up to $60 million for access to 23andMe's data to study Parkinson's. You think 23andMe was about selling fun DNA spit tests for $99 a pop? Nope, it's been about selling your data all along.

    testing ethics dna genentech 23andme parkinsons diseases health privacy

  • Facette

    Really nice time series dashboarding app. Might consider replacing graphitus with this...

    time-series data visualisation graphs ops dashboards facette

  • Getting good cancer care through 3D printing

    This is pretty incredible.

    Balzer downloaded a free software program called InVesalius, developed by a research center in Brazil to convert MRI and CT scan data to 3D images. He used it to create a 3D volume rendering from Scott's DICOM images, which allowed him to look at the tumor from any angle. Then he uploaded the files to Sketchfab and shared them with neurosurgeons around the country in the hope of finding one who was willing to try a new type of procedure. Perhaps unsurprisingly, he found the doctor he was looking for at UPMC, where Scott had her thyroid removed. A neurosurgeon there agreed to consider a minimally invasive operation in which he would access the tumor through Scott's left eyelid and remove it using a micro drill. Balzer had adapted the volume renderings for 3D printing and produced a few full-size models of the front section of Scott's skull on his MakerBot. To help the surgeon vet his micro drilling idea and plan the procedure, Balzer packed up one of the models and shipped it off to Pittsburgh.

    diy surgery health cancer tumours medicine 3d-printing 3d scanning mri dicom

Links for 2015-01-13

Links for 2015-01-12

Links for 2015-01-11

Links for 2015-01-10

Links for 2015-01-09

  • A World Transfixed by Screens - The Atlantic

    Excellent "In Focus" this week -- 'The continued massive growth of connected mobile devices is shaping not only how we communicate with each other, but how we look, behave, and experience the world around us. Smartphones and other handheld devices have become indispensable tools, appendages held at arm's length to record a scene or to snap a selfie. Recent news photos show refugees fleeing war-torn regions holding up their phones as prized possessions to be saved, and relatives of victims lost to a disaster holding up their smartphones to show images of their loved ones to the press. Celebrity selfies, people alone in a crowd with their phones, events obscured by the very devices used to record that event, the brightly lit faces of those bent over their small screens, these are some of the scenes depicted below.'

    mobile photography in-focus alan-taylor the-atlantic phones selfies pictures

  • "Incremental Stream Processing using Computational Conflict-free Replicated Data Types" [paper]

    'Unlike existing alternatives, such as stream processing, that favor the execution of arbitrary application code, we want to capture much of the processing logic as a set of known operations over specialized Computational CRDTs, with particular semantics and invariants, such as min/max/average/median registers, accumulators, top-N sets, sorted sets/maps, and so on. Keeping state also allows the system to decrease the amount of propagated information. Preliminary results obtained in a single example show that Titan has an higher throughput when compared with state of the art stream processing systems.'

    crdt distributed stream-processing replication titan papers

Links for 2015-01-07

Links for 2015-01-06

  • Mantis: Netflix's Event Stream Processing System

    Rx/reactive in style, autoscaling, support for queue/broker-based strong consistency as well as TCP-based lossy delivery

    netflix rx reactive autoscaling mantis stream-processing

  • Bad Kids Jokes

    'I now a man with a wooden leg named sea what was the name of the other leg SAND'

    funny humor kids jokes humour

  • The Hit Team

    Fergal Crehan's new gig -- good idea!

    The Hit Team helps you fight back against leaked photos and videos, internet targeting and revenge porn.

    revenge-porn revenge law privacy porn leaks photos videos images selfies

  • F1: A Distributed SQL Database That Scales

    Beyond the interesting-enough stuff about scalability in a distributed SQL store, there's this really nifty point about avoiding the horrors of the SQL/ORM impedance mismatch:

    At Google, Protocol Buffers are ubiquitous for data storage and interchange between applications. When we still had a MySQL schema, users often had to write tedious and error-prone transformations between database rows and in-memory data structures. Putting protocol buffers in the schema removes this impedance mismatch and gives users a universal data structure they can use both in the database and in application code…. Protocol Buffer columns are more natural and reduce semantic complexity for users, who can now read and write their logical business objects as atomic units, without having to think about materializing them using joins across several tables.
    This is something that pretty much any store can already adopt. Go protobufs. (or Avro, etc.) Also, I find this really neat, and I hope this idea is implemented elsewhere soon: asynchronous schema updates:
    Schema changes are applied asynchronously on multiple F1 servers. Anomalies are prevented by the use of a schema leasing mechanism with support for only current and next schema versions; and by subdividing schema changes into multiple phases where consecutive pairs of changes are mutually compatible and cannot cause anomalies.

    schema sql f1 google papers orm protobuf

Links for 2015-01-05

  • Avleen Vig on distributed engineering teams

    This is a really excellent post on the topic, rebutting Paul Graham's Bay-Area-centric thoughts on the topic very effectively. I've worked in both distributed and non-distributed, as well as effective and ineffective teams ;), and Avleen's thoughts are very much on target.

    I've been involved in the New York start up scene since I joined Etsy in 2010. Since that time, I've seen more and more companies there embrace having distributed teams. Two companies I know which have risen to the top while doing this have been Etsy and DigitalOcean. Both have exceptional engineering teams working on high profile products used by many, many people around the world. There are certainly others outside New York, including Automattic, GitHub, Chef Inc, Puppet... the list goes on. So how did this happen? And why do people continue to insist that distributed teams lower performance, and are a bad idea? Partly because we've done a poor job of showing our industry how to be successful at it, and partly because it's hard. Having successful distributed teams requires special skills from management, which arent't easily learned until you have to manage a distributed team. Catch 22.

    business culture management communication work distributed-teams avleen-vig engineering

  • Hack workaround to get JVM thread priorities working on Linux

    As used in Cassandra ( http://grokbase.com/t/hbase/dev/13bf9kezes/about-xx-threadprioritypolicy-42 )!

    if you just set the "ThreadPriorityPolicy" to something else than the legal values 0 or 1, [...] a slight logic bug in Sun's JVM code kicks in, and thus sets the policy to be as if running with root - thus you get exactly what one desire. The operating system, Linux, won't allow priorities to be heightened above "Normal" (negative nice value), and thus just ignores those requests (setting it to normal instead, nice value 0) - but it lets through the requests to set it lower (setting the nice value to some positive value).

    cassandra thread-priorities threads java jvm linux nice hacks

Links for 2015-01-04

  • Amiko Alien2 / Enigma Discussion Thread - boards.ie

    Enigma is a Linux based alternative to the default Spark operating system on these boxes. Enigma is a more customisable OS and provides the ability to add plugins which can accomplish many tasks enabling users to have a box which might look and perform like a Sky box, giving a 7 day EPG and an alternative to series link.
    Looks like a pretty solid hacker community...

    alien2 tv enigma dvr freeview saorview pvr

  • Hague reassures MPs on Office 365 data storage as Microsoft ordered to hand over email data

    William Hague, the leader of the House of Commons, has responded to concerns raised by an MP about the security of parliamentary data stored on Microsoft's Cloud-based servers in Europe. "The relevant servers are situated in the Republic of Ireland and the Netherlands, both being territories covered by the EC Data Protection Directive," William Hague wrote in a letter to John Hemming, MP for Birmingham Yardley. "Any access by US authorities to such data would have to be by way of mutual legal assistance arrangements with those countries." [...] John Hemming MP told Computer Weekly Hague's reassurances carried little weight in the face of aggressive legal action by the US government.  "The Microsoft case makes it clear that, in the end, the fact that Microsoft is a US company legally trumps the European Data Protection Directive [...] and where [the letter says] the US authorities could not exercise a right of search and seizure on an extraterritorial basis, well, they are doing that, in America, today."
    Sounds like they didn't think that through...

    mail privacy parliament office-365 microsoft mlat surveillance

Links for 2015-01-03

Links for 2015-01-03

Links for 2015-01-02

  • The open-office trend is destroying the workplace

    Wow, where has this person been for the past 20 years that they haven't had to encounter this? I can only imagine having a private office, tbh.

    my personal performance at work has hit an all-time low. Each day, my associates and I are seated at a table staring at each other, having an ongoing 12-person conversation from 9 a.m. to 5 p.m.  It's like being in middle school with a bunch of adults. Those who have worked in private offices for decades have proven to be the most vociferous and rowdy. They haven't had to consider how their loud habits affect others, so they shout ideas at each other across the table and rehash jokes of yore. As a result, I can only work effectively during times when no one else is around, or if I isolate myself in one of the small, constantly sought-after, glass-windowed meeting rooms around the perimeter.

    business office productivity work desks open-plan

Links for 2015-01-02

  • The open-office trend is destroying the workplace

    Wow, where has this person been for the past 20 years that they haven't had to encounter this? I can only imagine having a private office, tbh.

    my personal performance at work has hit an all-time low. Each day, my associates and I are seated at a table staring at each other, having an ongoing 12-person conversation from 9 a.m. to 5 p.m.  It's like being in middle school with a bunch of adults. Those who have worked in private offices for decades have proven to be the most vociferous and rowdy. They haven't had to consider how their loud habits affect others, so they shout ideas at each other across the table and rehash jokes of yore. As a result, I can only work effectively during times when no one else is around, or if I isolate myself in one of the small, constantly sought-after, glass-windowed meeting rooms around the perimeter.

    business office productivity work desks open-plan