The big device manufacturers DON'T WANT INTEROPERABILITY. They want you nailed down to their ecosystem and hit you with planned obsolescence. Like most anything else in the economy, they want premium pricing. If you adopt open standards, then you're competing with everyone else but now on price. The majority of device makers don't want to do that. THAT is the problem with the smart home.
Technology
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
Are there any open source smart home technologies? (For this reason but also for privacy's sake)
Homeassistant helps a lot in that respect.
Home assistant and zigbee/z-wave (also Bluetooth) resolve a lot of issues people have with smart home kit. Matter/Threads, discussed in the article, is supposed to be an open standard to make fancier kit from the big companies work together seamlessly, we just aren't quite there yet.
See:
I've got a few smart home devices (lights, plugs, weed vape, TV backlight) and literally none of it is proprietary and it all works even if my internet connection is down!
Home-Assistant.
Technology throttled by human greed
We probably have the tech, know-how and capability to build a permanent massive orbiting space station with a highly efficient way to get there and back.
But we're too busy fighting wars and trying to figure out how to screw each other out of another dollar. Most of our human energy and efforts are spent either trying to swindle money out of others or trying to protect ourselves from being swindled or just being swindled.
As someone who does live in a "fully smart" home, used quite some time to plan it and had to fend of "smarthome" manufacturers like flies aroud a shitcake:
90% of all products on the market are a scam and shouldn't be called smart at all - they are fancy "remotes" either via voice or mobile phone. Nothing about that is smart. That's dumb. It is not more convenient compared to a proper lightswitch if I need to know a long specific voice prompt or take my mobile out of its pocket to switch on a certain light.
What the autor of the article requests is already on the market for decades - KNX/EIB any a few other standards (Modbus, Onewire, etc.) are available for ages, are not depending on one brand and one central component. There is no fucking need to stay within a walled garden but the point is: These systems exist for such a long time that they do not show up as "big introduction" at IFA or CES. They evolve gradually and to stay within German exhibitions are found at the Light and Building rather than the IFA. Because the first one is a builders/electronics exhibitions, the later a multimedia/TV trade fair. The Verge is simply at the wrong place.
To give you an idea of my (actually very common, nothing about it is very special) setup/usecases and what I mean with "smart": KNX does everything that requires switching, all sensors, basically all background work excluding the doorbell (works via LAN) and Fingerprint (works via LAN).
Lights:
The system does recognise people automatically when they enter a room and their positioning in a room. Paired with enviromental data (natural light level in the room, outside light, time of the day, our schedule according to our calenders*) it determines the appropriate level of light based on the human centric lightning concept. Light will be brighter and more blue in the morning (unless I am coming home from nightshifts), darker and more orange in the evening (unless we have a party), very dark if you go to the loo at night. It furthermore recognises your positioning in the room (e.g. when you are in a certain part of the kitchen certain lights go on) or that certain power sockets draw power according to a certain charateristic (e.g. the TV goes on)
Temperature:
The system knows current inside and outside temperature and the expected forecast*. It will heat the rooms accordingly, e.g. will turn down the kids rooms during schooldays but have them back at temperature when school ends. If the system recognises that someone is still in the room for long after school should have started it determines that someone is sick/schools off unexpectedly and temps are adjusted accordingly. In the summer the system shuts the blinds according to the light level to keep the heat out - based on the current position of the sun(e.g. the eastern blinds are lowered in the morning but not the western ones) and outside light levels. It will let enough light in for everyone to work but at the same time keep the heat out.
Air quality:
The system measures the air quality of the rooms and outside air quality&temperature and does ventilate accordingly - or ask us to manually open a window if that doesn't provide sufficient clean air. (But won't do so if the Air quality outside is bad)
Windows/Doors:
All of them have sensors showing their opening status, some if they are properly locked.
Doorbell/Fingerprint:
The Doorbell/Fingerprint system is the only system not on the bus as Video is beyond the scope of what the system can transfer.
Devices/Appliances:
Most things are "dumb" integrated first- we see when the washing machine is done because of the power charateristic, we see if the refrigerator is broken the same way. While we use Home Assistant for additional comfort, it is not really necessary.
Visualisation:
We use both KNX only as well as Home Assistant. But I could change over to openHAB, ioBroker or whatever we want tomorrow.
*: This data has input from external sources.
My point is: This is done without much user input. And by using around 30 different brands. With dumb actors and sensors (blind e.g. are just a "on off" motor, windows are binary contacts, same goes for leakage, etc.) so the components can be exchanged easily. And you don't pay the hefty premium everyone tries to sell you for their "remote controlled blinds" (twice the price for a shitty remote,another useless gateway and Alexa...) and it's far easier to use different brands. And if the blind actuator brand goes bust (way more unlikely compared to a smarthome startup) it will work without a cloud and can be exchanged seamlessly with any other brand.
We are there. But it is not fancy enough for the media.
Would you mind sharing an approximate cost to have that all done?
As we had to redo all wiring anyway (renovation of a 80 y old house) and worked in stages it's a bit difficult to do an estimation. Generally we found KNX is about +15%/+20% to comparable conventional wiring depending on the complexity (conventional wiring is cheaper for simple "one switch one light" situations but gets immensely expensive for more complexity - we found KNX was cheaper for some situations like "four different switches in four different locations all switching different combinations of lights"). In total around 40k € for a large house- that includes rerunning all wires, a few specialities due to age of the house and installation by a master sparky but no programming by them(did that myself - it's not that difficult actually but takes a bit of time to get into).
The KNX wiring in theory could be done by a amateur as it is 24v only, but 240V needs a professional here. If we had done all KNX wiring ourself and let the sparky only do the 240V part (which in retrospect we should have done) we would have actually gotten out cheaper than conventional wiring, but I had no time to do so.
Of course the level of integration we opted for is far beyond what you normally put into a house - it's a hobby more or less and we will not break even in terms of energy savings ever - but as we had to do something anyway why not do it right. Additionally it is heavily geared towards us getting older (e.g. we have motion detection at the ground level beside the bed - this recognises if you get up at night and now switches the bedroom lights on at 5% red so the wife does not wake up and then switches the lights on towards the loo. The whole routine is capable of recognising that someone has fallen or is unable to get off the loo)
It all depends on the brands you choose - as KNX has a huge spectrum of suppliers there is everything from cheap switches that are hardly more expensive than regular ones and top notch switches that cost 500€ each...we went with rather cheap but flexible ones.
A friend did some calculations with normal "off the shelf" smart home stuff like Hue, etc. and was 20% above what we payed for comparable level of integration.
I have yet to see a “smart home” feature that’s worth the potential problems, let alone the cost.
Yeah, a well-integrated smart home can do some pretty cool stuff, but it also means putting my trust in corporations even more than I already have to. Plus, I’ll have to worry about each major appliance I own possibly being bricked due to a buggy software update or a malicious hacker.
Keep my home nice and dumb. Thanks.
All valid concerns, but if you really wanted to, you could roll your own home automation setup using something like a Raspberry Pi, and optionally Home Assistant, and keep it all offline so that it's safe from hackers.
Yes, you can, but it can be a lot of effort and a lot of time spent researching and tinkering.
It's fine if you want that to be your hobby, but it can be a heavy lift for the average person.
It’s surprisingly easy with Home Assistant. You really don’t need much tinkering, if any, to get the basics working quite reliably.
It’s surprisingly easy with Home Assistant.
Maybe for a more software focused person. I found it very cryptic the couple of times I tried (and failed) to get it up and running.
I'm much more comfortable with a soldering iron than a config file.
You may want to give it another shot. They've been working pretty hard to move away from config files - much more is done via the GUI these days to make things more user-friendly.
The devs have also really been focusing on voice this year as well - it's been really interesting to see what they come up with. A few releases back, they released an update that allows you to give voice commands to HA via a landline phone hooked up to a $30 VoIP box. There is also support now for Espressif's new "S3-Box" devices, which have small screens, a speaker and a few microphones for under $50 - this does require messing with yaml files at this point, but I should be able to finally ditch my Echos soon!
It’s easy for techies like us, yeah. If we don’t want to go too advanced with the automation stuff. I wouldn’t even dare ask my mum to set up her own stuff, even if she begged me for it. It’s techie-friendly. Not user-friendly (yet).
Good point. I was assuming that “smart home” integration would require an internet connection, but that doesn’t have to be the case. Thank you for clarifying that!
You can easily have a smart home without any data leaving your home network.
You need three things:
- Home Assistant software (free and open source)
- ZigBee (also free and open source) smart devices made by companies that comply with the ZigBee protocol
- Most importantly, a ZigBee controller.
There are several options available (Deconz Conbee II, etc), and this device gets plugged into the same machine Home Assistant is on, and it allows HA to control your ZigBee devices directly. No "hub" sending your data to a cloud server, everything is done on your local network. If the devices comply with the protocol, you don't need their hub, even if they say it's required.
I use Hue bulbs, but have no Hue hub. I use many Aqara devices, but don't have an Aqara hub. It's pretty great and works very well!
The proprietary/cloud based threat bit me already. Installed smart vents in my home several years ago. They weren't perfect, but they did really help even out my 3-bedroom, 2-story, 1-zone home. Now the app fails to login, the site doesn't even attempt password recovery and I'm back to dumb vents... Customer support is a black hole and basically every product is and has been out of stock for years, so I've no hope of any happy resolution.
They apparently used to be supported by SmartThings when it allowed custom stuff, but that's dead now too because Samsung didn't want to allow it. I even tried to use their proprietary hub which said it could connect to them, but that shit didn't work either.
If they’re SmartThings then they can probably be controlled with a Z-wave dongle and HomeAssistant
I know someone living in a really high-end "smart" home. We're talking about a ton of hardware and proprietary software controlling practically everything in the house. From one app in a phone or iPad, you can control everything from the security cameras to the heater to the pool.
It's basically the pinnacle of what all this technology intends to achieve, and tbh, it's all a bit of a pain.
Diagnosing anything in the house has an extra layer of work. Is it the pool heater not working? Oh, no, it's the app not working. Security alert from the house? A fly walked across the camera lens. Everything acting weird all the sudden? Guess the shitty monopoly broadband cable provider in the city is having issues again.
The system only stays afloat because of a 24/7 service contract with a company that specializes in these houses. Give a few months without that support, and things will start falling apart.
I get that this is a different class from the products from Google and Amazon, or even the various open source products, but tbh, I'll take fragmented over monolithic and overarching.
I may be a bit cynical here, but to me, current smarthome systems are about two things: a) vendor lock-in, and b) holding your house hostage to push you away from one-time purchases and onto subscription services, much as is already hapening with computers/smartphones and modern cars.
From the seller's point of view, subscription services have several huge advantages: they ~~can milk you~~ have a guaranteed revenue stream for the lifetime of the system, they can collect/sell lots of data about you, and they can ram any TOS changes down your throat which you will accept as long as you care about being able to turn on the lights in your kitchen.
Interoperability is really bad for vendor lock-in, so I'm curious as to which supplier will implement it to what degree.
As for our house, it has some smart things, but none of those are connected to the internet, nor do I expect they ever will be.
For all its faults and risks, a smart home can still make your life a lot easier.
proprietary software
Found your problem.
Let's not pretend open source smart homes are perfect either. I hve immense respect for the Home Assistant project, but making it all work seamlessly is a nearly impossible task.
I mean, I agree, but the target market of a lot of this stuff couldn't care less. They want their hot tub synced up to their Outlook calendar or whatever, and can afford a monthly maintenance contract to keep that working.
For the rest of us, there's this sort of odd limbo. Most people expect some kind of remote control app as part of their smart stuff, which means either going through an outside cloud service, or running your own server and contending with the fact that most of us don't have a static IP. Of course there are services like no-ip, but again, you're stuck using someone else's cloud service, just for a much smaller part of the overall task.
My point at the end though is that I don't necessarily want "all in one" control, whether open source or proprietary. I've seen what well-implemented smarthome looks like, and it does not (to me) seem worth the money or time. I'll take the ecobee, maybe the security cameras, and I'll even go though their commercial cloud to get that remote connectivity, but I'd rather keep my services separate, than go all-in on one hardware/provider/app.
or running your own server and contending with the fact that most of us don’t have a static IP
Just buy a domain name and use dynamic DNS, it is what I do. I'd argue that what you have seen is far from well implimented, but to each their own of course.
If you don't use zwave/zigbee for your smart home you're missing out.
The best smart home platform before are this was home assistant. And by gosh it still is the best by a mile. The difference in functionality home assistant has to anyone else is an ocean wide win for home assistant. It’s the only thing that even comes close to the utopia idea of a smart home so many have given up on. I love my home assistant 💜
Is there some reason just using z-wave and avoiding everything cloud is not just fine?
Seems like matter is more trying to resolve zigbee issues. Or am I missing something?
So a couple of things. Z-Wave is a proprietary protocol (developed by a single company called Zensys) and is a closed ecosystem, so personally, I'm not a fan of it. And it's not great choice for interoperability either.
Zigbee on the other hand, is an open standard (IEEE 802.15.4), made by the Zigbee alliance, comprising of major tech companies. The Zigbee alliance later became the Connectivity Standards Alliance (CSA), who are the ones behind Matter. Which is why it appears as if Matter is trying to resolve Zigbee issues.
In actuality though, Matter is trying to proposition itself as a generic standard for the modern IoT world, because things have changed significantly since the times when the Zigbee and Z-Wave protocols were conceived (late 90s - early '00s). The main thing that's changed is that low-power and cheap system-on-a-chip (SOCs) and single board computers (SBCs) have taken over the world by storm, which has enabled manufacturers to push out cheap home automation products quickly. Making home automation products is no longer a traditional embedded systems and specialized electronics play, where you had to invest a lot of RnD into designing complex circuits, pay for a Z-Wave license etc. Nowadays, even a kid could make their own system using a Raspberry Pi and say Python, without needing any knowledge of low-level protocols or languages.
As a result, the home automation world is filled with too many manufacturers and products, all trying to do their own thing and in-effect, building several closed ecosystems, even though they're all basically using the same protocols behind the scenes. Plus you also have the existing Zigbee and Z-Wave products.
So before Matter came into the picture, several manufacturers started making their own centralized hubs, as a means for interoperability, like Samsung's SmartThings, or Apple's HomeKit etc. Some even have their own closed hubs meant for their own ecosystem of devices, like the Philips Hue bridge. As a result, some homes may even have multiple hubs, with overlapping functionality.
Matter aims to unify all of that. So instead of Philips doing their own thing, instead of Samsung coaxing manufactures to make their systems compatible with SmartThings, instead of manufacturers kissing Apple's ass to support their products, instead of x company making some half-baked bridging app for y company because the specs haven't been fully documented or they simply don't care.. we have Matter. Matter aims to solve that mess, at least, on paper. It would still require manufacturers to actually buy into the idea and support the protocol, but at least it's better than working individually with Samsung and Apple and Amazon etc, or reinventing the wheel and doing their own thing.
As far as I know z-wave has been open for years. Is there something not so about that?
I guess I stand corrected-ish. I've always ignored Z-Wave because it was a closed ecosystem. But upon reading more into it, seems like it's only partially open. They only opened certain parts of the spec for interoperability in late 2016, the standard was ratified by the ITU in Dec 2019, and they formed the non-profit Z-Wave Alliance only in 2020. They apparently made the source code available end of last year, but it's only available to the Z-Wave Alliance members.
So, still not ideal IMO, but better than what it was a decade ago I guess.
Ah the internet of infected things. Everything a mash up of open and closed source, old and new, then abandoned by the manufacturer after a few years for the next shiny.
Probably Linux based, wait to be taken over by a few botnets...
What is needed is an open, standardized hardware platform. You should be about to flash on the IoT OS of your choice that will be kept up to date.
You mean like KNX?
Which we have for 3 decades now, is totally offline if needed and can by design not leak data without the user noticing, is available both wired an non-wired, is compatible across hundreds of manufacturers and even has some open source projects, is totally backwards compatible and does not require a fancy "central component" that might stop the whole system functioning?
Seriously: The whole smart home world is a scam. 90% of all products that are new and fancy are nothing more than "voice/mobile remotes" and not truely intelligent. They are used because people refuse to do their homework in terms of smarthome.
Will Apple sell more devices if they fully support the standard? Will Google?
If not, there's your answer.
Apple isn't really a good example, they're pushing the standard. I don't know of any smart devices they make themselves besides the homepod.
Will Apple sell more devices if they fully support the standard?
I stand to the question. Apple is pretty famous for saying what people want to hear, and not actually doing much.
My cynical interpretation of the right-to-repair announcement is: we know Europe is gonna cram this down our throats, so let's try and get control of the narrative while there's still time.
Is supporting this open a standard a law? It sounds like it could be an EU law, and it being one is the only reason companies would do it.
The GitHub, if you're wondering how exactly this thing works. A blog explaining it, and an example.
Is there any particular reason HTTP couldn't have done all this?
HTTPS is heavy when you’re talking about the extreme low power, bandwidth, and compute devices matter is intending to support
its also not a broadcast protocol - matter intends to connect many devices to many devices
those are off the top of my head; i’m sure there are more. HTTP is great, but new/alternate network protocols aren’t inherently bad: especially when you’re operating in a very constrained/niche environment