Armin Osmancevic

The robots are taking over

Innovation, News, Software, Technology

No Comments


Share this post

I don’t know if I should be happy or go and watch Terminator again to see what is ahead of us. This is awesome, but also scary. Where are we going with all the technology? I mean, if these things can do THIS now, what will they be able to do in 2025?

Google car: It drives itself:

 

Flying robots playing James Bond Theme simultaneously:

 

Human-shaped robot that walks while avoiding moving people, balance itself on uneven surfaces, hop on one foot and pour a drink:

 

Human-like robots imitate expressions from the people:

 

 

 

Read more

Apple’s new Next Great Interface

3D, Innovation, News, Software, Technology, Usability

No Comments


Share this post

 

On January 12, 2012, the US Patent & Trademark Office published a patent application from Apple that reveals an exciting new 3D GUI for iOS mobile devices. The new UI will work with proximity sensor arrays and will respond to hovering gestures. The Crazy Ones in Cupertino have been working on advanced 3D GUIs for some time now. We first learned of a major 3D GUI project back in 2009 that involved using head tracking technology. Then in early 2010 we learned of Apple’s first project relating to a 3D GUI for iOS devices. Later that year Apple 3D multifunctional widgets and over time revealed advanced 3D and hovering based gesturing for CAD users on an iPad. With twenty times the GPU power coming to iOS devices over the next year, Apple appears to paving the way for a new 3D GUI for mobile devices in the not-too-distant future.

 

Apple’s Patent Background

Modern computer operating systems often provide a desktop graphical user interface (“GUI”) for displaying various graphical objects. Some examples of graphical objects include windows, taskbars, docks, menus and various icons for representing documents, folders and applications. A user could interact with the desktop using a mouse, trackball, track pad or other known pointing device. If the GUI is touch sensitive, then a stylus or one or more fingers could be used to interact with the desktop. A desktop GUI could be two-dimensional (“2D”) or three-dimensional (“3D”).

Modern mobile devices typically include a variety of onboard sensors for sensing the orientation of the mobile device with respect to a reference coordinate frame. For example, a graphics processor on the mobile device could display a GUI in landscape mode or portrait mode based on the orientation of the mobile device. Due to the limited size of the typical display of a mobile device, a 3D GUI could be difficult to navigate using conventional means, such as a finger or stylus. For example, to view different perspectives of the 3D GUI, two hands are often needed: one hand to hold the mobile device and the other hand to manipulate the GUI into a new 3D perspective.

 

Apple’s Wild Solution

Apple’s latest invention is a wild one indeed. The invention covers a 3D display environment for mobile device that uses orientation data from one or more onboard sensors to automatically determine and display a perspective projection of the 3D display environment based on the orientation data without the user physically interacting with (e.g., touching) the display. In some implementations, the display environment could be changed based on gestures made a distance above a touch sensitive display that incorporates proximity sensor arrays.

In some implementations, a computer-implemented method is performed by one or more processors onboard a handheld mobile device. The method includes generating a 3D display environment; receiving first sensor data from one or more sensors onboard the mobile device, where the first sensor data is indicative of a first orientation of the mobile device relative to a reference coordinate frame; determining a first perspective projection of the 3D display environment based on the first sensor data; displaying the first perspective projection of the 3D display environment on a display of the mobile device; receiving second sensor data from the one or more sensors onboard the mobile device, where the second sensor data is indicative of a second orientation of the mobile device relative to the reference coordinate frame; determining a second perspective projection of the 3D display environment based on the second sensor data; and displaying the second perspective projection of the 3D display environment on the display of the mobile device.

 

Apple’s 3D Environment for Mobile Devices

Apple’s patent FIG. 1A shown below illustrates a perspective projection in a 3D display environment of a mobile device using orientation data derived from onboard sensors.

 

 

 

In some implementations, the mobile device includes display 102 presenting display environment 104. For example, the mobile device could include a touch-sensitive surface that could receive touch input and gestures. The display environment could be a 3D GUI having a floor (106), back wall (108), ceiling (110) and sidewalls (112a and 112b). One or more two-dimensional (“2D”) or 3D objects could be presented in the display environment. In the example shown, 2D object (118) is pasted to the back wall and 3D objects (114 and 116) are resting the on floor.

Apple’s proposed display environment could be a perspective projection of a 2D desktop or homepage for an operating system or application. The perspective projection could be conceptually understood to be the view from an imaginary camera viewfinder. The camera’s position, orientation and field of view could control the behavior of a projection transformation or camera transform.

 

Shifting Camera Views

Apple states that the “camera view” of the display environment changes when a viewer rotates their mobile device about a gyro sensor axis. If no gyro sensor is available another sensor such as the magnetometer or accelerometer could be used.

In some implementations, the display environment is determined based on the current orientation of the mobile device as indicated by one or more onboard sensors. For example, the display environment could be displayed when the viewer holds their mobile device with the display directly facing them. In this orientation, the camera view is directly facing the back wall. As the user rotates their mobile device either clockwise or counterclockwise, the camera view is moved towards either side wall.

More particularly, as the user rotates their mobile device clockwise (about the X axis of rotation), the camera view moves toward sidewall 112a. Likewise, as the user rotates their mobile device counterclockwise, the camera view moves toward sidewall 112b. As the user rotates their mobile device clockwise (about the Y axis of rotation), the camera view moves toward the ceiling. As the user rotates their mobile device counterclockwise (about the Y axis), the camera view moves toward floor.

By rotating mobile device about the X and/or Y axes, the viewer is easily able to change the view of their display environment as desired to view various icons or documents as presented on the display.

Angular rotation about the X and Y axes could be measured or estimated from data provided by gyro sensors, accelerometers, magnetometers or any combination of sensor data that could provide an estimate of the orientation of the mobile device relative to a reference axis of rotation.

 

Apple Introduces a “Snap To” Feature

Apple’s patent FIG. 1B shown below illustrates a perspective projection in a 3D display environment using orientation data derived from onboard sensors, and including a “snap to” feature for changing camera position in the display environment. Note what was on the left wall of patent figure 1A is now positioned in the center back wall of the 3D environment in patent figure 1B below. As the user rotates their device, a new view of their display environment could be seen and snapped into place so that they could interact with it.

 

 

 

When using the mobile device, there are physical constraints on the amount of any particular rotation. If the viewer rotates their mobile device about the X or Y axis too far, the viewer will no longer see their display environment 104.

 

Exemplary Process

Apple’s patent FIG. 2 shown below is a flow diagram of an exemplary process 200 for determining perspective projections in a 3D display environment using orientation data derived from onboard sensors.

 

 

 

Multiple GPUs and a 3D Graphics Rendering Engine

In some implementations, the process could begin by generating a 3D display environment for a display of a mobile device. The 3D display environment could be displayed using one or more graphics processing units (e.g., NVIDIA GeForce 330M) and a 3D graphics rendering engine, such as the open source object-oriented graphics rendering engine (“OGRE“).

Yet a development this week may prove to be the more likely GPU candidate to power Apple’s proposed 3D GUI for mobile devices. At the Consumer Electronics Show in Vegas this week, Imagination Technologies presented their new PowerVR G6200 and G6400 GPU IP cores – which may be able to offer up to 20 times the performance of smartphones currently on the market today. We discussed advances coming from Imagination Technologies in our December 12, 2011 report titled “Apple Pounds out a New Round of Camera Related Patents.” Being that today’s 3D GUI patent relies heavily on utilizing the cameras built-into Apple’s iOS devices, the developments presented in Vegas this week are very relevant.

 

3D Environments for a Full Range of Devices  

Some examples of mobile devices that will be able to implement Apple’s proposed 3D environment include but are not limited to: a handheld computer, iPod touch (a personal digital assistant), an iPhone, an iPod, iPad, network appliance, a camera, an enhanced general packet radio service (EGPRS) mobile phone, a network base station, an iPod, a navigation device, an email device, a game console, or a combination of any two or more of these data processing devices or other data processing devices.

 

The War over the Next Great Interface will be with us for a Decade

In October 2011, Microsoft revealed their upcoming Metro UI for portable devices and made a pitch at how it would be so much better than Apple’s use of static icons. Well, just when Apple knew that Microsoft would be trying to copy iOS in some fashion, we now see Apple’s revelation of how they may take a future iteration of iOS to the next level. Time will tell of course if Apple gets this 3D GUI out to market in a timely manner. But at the moment, it looks very promising indeed. In the bigger picture, the war over the next great interface for larger tablets, TVs and our vehicles are still up for grabs. But between Apple’s advanced work on 3D graphical user interfaces as well as audio-centric user interfaces like Siri, it sure looks like Apple has the wind at its back.

Apple’s patent applicationwas originally filed in Q3 2010 by inventor Patrick Piemonte. For more on Apple’s 3D related patent applications, see our Archives.

 

Other Noteworthy Patent Applications Published Today

Apple has designed and invented a new power adapter with an arm mechanism that is manufactured from a single piece of material. The plug arm could include a plug operative to extend into a wall socket, an elongated plate coupled to an end of the plug such that the plug extends from a first surface of one end of the plate, and a pin coupled to the opposite end of the plate and extending from the opposite surface of the plate.

That’s a very nice description from Apple, but it’s still an odd power adapter to me. Yet perhaps the super geeks amongst us could make sense of this (ha!) – and let us know below in our comment section.

 

 

For more information, see patent application 20120005897.

[via Patently Apple]

 

Read more

20 HTML5 sites that changed the game

Animation, Campaign, Innovation, Interactive, News, Software, Technology, Web

No Comments


Share this post

This year HTML5 truly rocked. Oli Studholme, one of the HTML5 Doctors, runs through 20 of the best sites and covers semantics, audio, client-side web apps, canvas as well as SVG and WebGL and looks ahead to the future

2011 has been an amazing year for HTML5 and the web. We’ve seen HTML5 continue maturing, progressing to Last Call status in May and on track to be a W3C specification by 2014. The WHATWG have been busy with both improvements to HTML5, and new post-HTML5 features such as WebVTT. The progress for browsers has also been staggering, with all five main players actively pushing the boundaries of the web, and Firefox joining Chrome, Opera, and to a lesser extent Safari in frequent, automatic updates. One more to go!

On the content side, it’s really felt like 2011 has been the year the HTML5, CSS3 and JavaScript web stack has come of age. HTML5 is now the default for most developers, and impressive explorations of the new features HTML5 makes available have been coming thick and fast. Here’s a tiny sampling of some sites that rocked HTML5 this year. Quite a few of them made my jaw drop with the feeling “I can’t believe this is the native web”.

Semantics

1. HTML5 For Web Developers

HTML5 for Web Developers might seem like a strange site to include here, because it’s just a version of the HTML5 specification. Historically W3C specifications have tended to be confusing, written for people who make web browsers, not websites. However, the HTML5 spec text is surprisingly readable, and peppered with examples. If you’ve had bad experiences reading W3C specs in the past, you might be pleasantly surprised.

HTML5 For Web Developers was made by Ben Schwarz and friends to be “a companion specification for web developers to use on a regular basis”. It’s a restyled version that drops the “implementor notes” for browser makers, perfect for web developers. Under the very readable print-influenced styling are some nice HTML5 additions too. It uses Offline Cache, and saving it shows a progress bar in supporting browsers using <progress> and the AppCache API. The search-as-you-type feature also works offline, and of course the search box uses type="search".

It also represents how we can all make a difference. Ben did this as a volunteer project, andthe source is on GitHub. And as web devs we have the skills to do so! Which takes us nicely into …

 

2. Move the Web Forward

Move the Web Forward by Mat MarquisAaron ForsanderConnor MontgomeryPaul Irish,Divya ManianNicolas GallagherAddy Osmani and friends shows you how “you can make the web as awesome as you want it to be”. It lists a range of things for all abilities that you can do to make the web better.

The one-page site features clean HTML5 code, using data-* attributes to tie in Twitter hashtag searches. It also has an adorable but invalid doctype:

  1. <!DOCTYPE html public “i &hearts; the web”>

(The important bit is <!DOCTYPE html, which triggers standards mode.) But above all, more than any of these awes HTML5 websites, Move the Web Forward’s message is crucial. InBeyond the Blue Beanie?Stephanie (Sullivan) Rewis comments “As the saying goes, many hands make light work. How fantastic would it be if there were so many hands that the burden didn’t fall on just a few? Together, let’s make the web rawk even harder!”. You can read more in Addy Osmani’s The Smashing Guide To Moving The Web Forward.

 

3. Boston Globe

The Boston Globe website is the poster child of a beautiful commercial “responsive web design” website. Built mobile-first, it behaves well in old browsers, even those without support for media queries or JavaScript. Scott Jehl of the Filament Group says “Every critical feature of the site was designed to work independent of JavaScript, but enhanced with richer JavaScript-driven interactions in capable browsers.”

Scott continues “We used HTML5 for a number of reasons. Mostly, it’s future-friendly and offered features that were useful in our feature set. For example, we made wide use of data-attributes for configuring behavioural options or associating content enhancements, we also appreciated the ability to use newer semantic elements in place of div/p/span where they made sense.”

 

Audio

4. Anatomy of a mashup

Cameron Adams combined his love of music, DJing, datavis and sweet web tech into Anatomy of a mashup.

The audio of his mashup of Definitive Daft Punk is visualised using the <audio> API and<canvas>, with support from CSS3 transforms and transitions. Cameron says “All of the waveform and spectrum visualisation is performed in realtime, so your browser is rendering a music video on the fly!” Proving that Flash isn’t dead yet, Cameron used a custom Flash app to get the audio spectrum data.

On HTML5, Cameron says “The thing that I love most about working with HTML5 is the immediacy of development; I can edit a JavaScript file, hit refresh and see what I’ve done immediately. No compiling, no special plugins. It’s the most accessible way of getting my work out there.”

 

5. SoundCloud

SoundCloud is a service for recording and sharing sounds, and is a popular way for artists and DJs to share mixes and expand their fan base. It’s also a great case study in pragmatic use of HTML5. While the desktop web app uses Flash to play audio, there’s an option to use HTML5 Audio in settings. This has also allowed SoundCloud to support the iPad, and they’verecently released an HTML5-based widget.

In addition to <audio> and the Audio API, they also use data-* attributes heavily, plus Canvas, SVG, and LocalStorage. Matas Petrikas says “We are especially proud of our use of Canvas in rendering of the widget waveform, the optimisations helped us to reduce the CPU load compared to Flash significantly”. Unfortunately there’s also some user agent sniffing (albeit for pragmatic reasons), and little use of new HTML5 elements or form attributes (although this is changing).

However, HTML5 Audio is not the default due to what Matas describes as “the poor state of HTML5 Media API implementation in web browsers”. To combat this Tomás Senart and Yves Van Goethem created the audio test suite “Are We Playing Yet?”. Matas says “The response has been overwhelming, we already have most of the browser makers participating, and we look optimisticly towards 2012!”

Additional problems in mobile devices include recording sound, the lack of widespread support for position:fixed for UI, and the lack of frequent (or any) mobile browser updates – Android WebKit is becoming the modern IE6. Because of this SoundCloud heavily promote their native apps to iOS and Android users. Matas says “we want to offer users the best experience possible, and currently the mobile browsers are still behind”. However, the future still holds promise: “we are big advocates of the upcoming device API (getUserMedia) and we hope in future to be able to capture sounds in the browser without Flash”.

These areas highlight some current problems in both specifications and browsers, but it’s certain both will continue to improve rapidly. For example Mobile Safari now supports background audio, GeoLocation and accelerometer. Even with the problems Matas says compared to Flash making the HTML5 version “was a pretty fast process. Debugging and optimising were also easier. This allows us to build and iterate faster, and in the end our users are happier too!”

 

6. The Wheels Of Steel

The Wheels Of Steel by Scott Schiller is two turntables and a mixer, live in the browser.

The demo uses HTML5 Audio where supported, with Flash as a fallback, via Scott’s JavaScript library SoundManager 2. It also uses some other fun stuff, including <input type="range"> for the crossfader and localStorage, plus a bunch of CSS3 for the impressive visual bling. Rather than go into detail, I recommend you read Scott’s excellent article The Wheels Of Steel: An Ode To Turntables (in HTML). I especially like this quote: “the page gracefully degrades and the core UI + content renders nicely even with JavaScript turned off. Blank or illegible pages shown to users without JS … reflects poorly on the site developers.”

 

Client-side web apps

7. Dabblet

Dabblet is marauding maker of awesome Lea Verou’s newest tool – a live CSS sandbox that saves as GitHub gists, and runs entirely client-side.

It uses a raft of HTML5 and related goodies, including CORS (cross-origin resource sharing), localStorage, the History API, the Selectors API, data-*,contenteditable, and inline SVG. Lea’s considering using the Drag & Drop API for resource embedding and the Offline API in the future, but says “the offline API is a huge pain in the arse”. She also tried using Web Workers for asynchronous syntax highlighting, but this made it seem slower. She’d also love to use the currently-being-specced UndoManager API once it is implemented, as “a big portion of dabblet’s code is devoted to recreating Undo/Redo”.

It also uses Lea’s controversial -prefix-free library to handle CSS vendor prefixes automatically. Lea’s considering a no-prefix-free option, or potentially adding something like LESS. While Eric Meyer has eloquently stated the case for vendor prefixesDivya Manian,Henri Sivonen, and Lea have all written on how vendor prefixes – as currently used (copy, paste, forget) have problems. While not HTML5, it’s an interesting issue about a fundamental part of how we work, and the CSS Working Group would welcome input via www-style.

Because the target audience are web developers, Lea hasn’t worried about backward compatibility. “If it was for a less tech savvy audience where IE is a concern, I’d still use HTML5, but with proper polyfills and fallbacks in place.” On HTML5, Lea says “HTML5 means three things for us developers: speed, universality, and openness. Making cool things is now easier than ever.”

 

8. Font Dragr

font dragr by Ryan Seddon allows you to preview custom fonts in the browser by simply dragging a font file from your computer into font dragr, or choosing from a list. Even better, you can use the font dragr bookmarklet and change the fonts on any site, targeting each font using a CSS selector. This lets you preview and compare fonts for @font-face use quickly, leaving the coding until you’ve decided.

It uses new HTML5 elements, the Drag and Drop API, the History API, the contenteditableattribute, and localStorage. Support for Google Web Fonts is also in the works. Ryan says localStorage is used to “do an ajax request which will get the view html, replace it in the DOM and then cache that view html in localStorage. So it only needs to do a network request the first time around.” On HTML5, Ryan simply says “it is the future”.

 

SVG

While not part of the HTML5 spec, some amazing sites have also been making great use ofthis powerful vector drawing specification.

9. Slavery Footprint

Slavery Footprint is an interactive survey that answers the question “how many slaves work for you?” to raise consciousness about modern-day slavery.

It heavily uses JavaScript to lazy-load and animate content, along with new HTML5 elements, GeoLocation and SVG. While in a modern browser the results are compelling and highly effective, sadly the site is not built with best practices. The survey form is unusable without JavaScript, and the information about slavery (“What? Slaves work for me?”) is inaccessible text-as-image. Perhaps because it didn’t start “content first”, Slavery Footprint also initially had some teething troubles, both with hosting and providing support for old browsers – the client was the USA State Department, who were still using Internet Explorer 7. Despite the problems it’s been successful in interactively raising awareness of modern slavery.

 

10. Kern Type

Kern Type is a type kerning game by Mark MacKay that is strangely addictive. You try to move the letters in a word to correctly kern them, and are scored on how well you did. Each word is in a different font too.

In addition to SVG with the help of the JavaScript library Raphaël to draw the letterforms, it uses data-* attributes for font data (the initial positions and the x-height), and Raphaël’s drag-n-drop for interactivity.

Mark says “I didn’t plan supporting tablets, but when I was almost finished I fired up Kern Type on my iPad and I was pleasantly surprised: not only was it almost 100% functional, the animations were smooth and the drag and drop worked great. All I had to to was add a couple of lines of JavaScript to prevent the page from scrolling and that was it.” He ended up using Raphaël drag-and-drop because with HTML5’s “I would have had to build an interface between Raphaël and my custom made javascript. I would have used HTML5’s drag-and-drop if I needed to drop over targets, as that’s notoriously difficult.”

When you complete it, have a go at the sister game Shape Type, and stay tuned for Method of Action’s first course “Design for programmers”, of which they’re both a part of.

 

11. SVG Girl

SVG Girl is a demo site produced for the Internet Explorer 9 release. It showed off IE9’s SVG powers with a very Japanese flip-book type animation running at 10 SVG frames per second, with sound via the <audio> element and an intro <video>.

It was made by the core members of jsdo.it, a social coding community site for creating, sharing and forking JavaScript, HTML5 and CSS code. This is run by Kayac, who describe themselves as “the most playful company in Japan” (as their great `data-*` and SVG-powered team page demonstrates).

I’ve yet to see any Japanese schoolgirls experiencing such a transformation while using Windows Phone 7.5, but hey it’s Japan — anything is possible ;) For another interesting Japanese example, have a look at The Shodo, a <canvas>-based traditional calligraphy web app, that stores stroke info as SVG paths.

 

Canvas

12. Peoplemovin

Peoplemovin is a personal project from Carlo Zapponi to show migration flows across the world, based around a flow diagram (inspired by Sankey diagrams). More than 215 million people, three per cent of the world population, live outside their countries of birth. Peoplemovin makes it easy to investigate migration by country, with intuitive visual representations explaining the statistics.

Carlo says “The foundation of the website is the canvas, all the interactions and visualisation happens in the space of the canvas that let me draw the connecting lines between the countries. I also used some CSS3 rules for rounded corners, shadows and glows and fonts.” In addition to the latest browsers it also works on smartphones and tablets. Carlo ended up making his own open-source toolkit called DataMovin to achieve this, which he plans to release at some stage (check the source in the meantime).

Describing HTML5, Carlo says “What’s great about HTML5 is that it is the perfect platform for creativity. You have a new crazy idea? Great! In a shorter time than ever before you can build anything into the browser without reinventing the wheel every time.”

 

13. Rally Interactive

Rally Interactive’s website contains a masterful example of creatively using canvas for interactivity. The triangular shapes react to hover and click in a way that until recently would have required a plugin like Flash.

As Wes Pearce says “We simply couldn’t have gotten the effect we wanted for our site without the HTML5 canvas. Support for the canvas in the latest browsers is shockingly uniform. We also put the new History API to good use, and were surprised at how quick it was to implement.”

 

14. Up and Down the Ladder of Abstraction

Up and Down the Ladder of Abstraction by Bret Victor is a great example of using interaction in support of text to really communicate ideas.

<canvas> examples are injected into the essay, allowing you to interactively learn about the point being made. I think this kind of thing is going to be a major part of future educational books, making ePUB 3 and HTML far superior to PDF, ePUB 2, and Kindle Format 8.

 

15. Sumon

Sumon is a simple addition game with great attention to detail. It’s been made by Ludei as a tech demo for their CAAT framework, which outputs to Canvas, WebGL and DOM/CSS.

As with Agent 008 Ball and Pirates Love Daisies from 2010, it’s a great example of the combination of canvas and audio plus talent – a fun game that runs right in your browser. It’s also available in the iTunes, Chrome and Android stores, plus as a Facebook game, all from the same codebase. That’s the kind of reach native apps just don’t have.

Iker Jamardo writes “JavaScript and HTML5 features are great game development platforms. The main disadvantage we found is poor performance in mobile device browsers.” While Ludei believes this will improve eventually, they’ve developed the Cocoon and CocoonJS frameworks to achieve native performance on mobiles. Iker concludes “we deeply believe JavaScript and HTML5 are great for game development and multiplatform deployment”.

 

WebGL

WebGL is again not part of the HTML5 spec – it’s a separately specified API that allows 3D graphics to be used in <canvas>. However, for crazy eye candy it’s hard to beat. Rather than go into details, let’s just see some examples:

16. HelloRacer

HelloRacer by HelloEnjoy, a sweet drivable F-1 race car.

 

17. WebGL Shader — Travelling wave fronts tech demo

The travelling wave fronts tech demo is a “fine-tuned 8bit reaction-diffusion system with added traveling wave fronts and subpixel decay”. Mesmerising.

 

18. ROME “3 Dreams of Black”

ROME “3 Dreams of Black” is an interactive music video by Chris Milk and friends, to music by Danger Mouse, Danielle Luppi and Norah Jones.

Don’t miss their tech demos and video about the technology behind the movie.

You can learn more about WebGL, and see more amazing examples, in Dev.Opera’s “An introduction to WebGL” (and “Porting 3D graphics to the web”) by Luz Caballero. Opera is also preparing a comprehensive list of WebGL tutorials, coming “very soon”.

 

The future / the present

There’s a lot of amazing stuff coming to the web stack too. Let’s look at just one example – the WebRTC (Real-time communication) specification (getUserMedia). This allows you to “exchange real-time, interactive media, including audio and video”, with a major use being video chat between browsers. Opera also has experimental support for getUserMedia in developer builds for both desktop and mobile.

19. Browser-based video chat

Ericsson Labs has been working on this for a while, and has a WebKit library for download(more info and tutorial).

 

20. Face detection/moustache demo

Opera also has experimental support for WebRTC, and the DeviceOrientation Eventspecification, in a custom build called Opera Labs Camera and PagesRich Tibbett wroteNative webcam support and orientation events on using both specs, and made a demo using WebRTC that performs face detection on live video. If that isn’t awesome enough, it also allows you to add a moustache. To live video. In the browser.

 

Bravo, interwebs. Bravo.

Conclusion

As you’ve no doubt noticed by now, despite grouping these websites by an HTML5 technology they use, they’re all using way more than just one. While not everything is ready for adoption, there’s a lot of goodness in the HTML5 specification (and other web stack specs like SVG and WebGL) that you can use right now. Keep up to date and find out more atHTML5 Doctor, the W3C’s Planet HTML5 and on Twitter with @HTML5.

The “HTML5” buzzword has been a double-edged sword, but it’s helped the bandwagon gain momentum and made an impression on management too. Hopefully with this pile of inspiration you’ll return to the first two sites in the article, go forth and make awesome!

[via .netmagazine and @designchapel]

Read more

Most Insane Immersive Movie Experience

Animation, Innovation, Motion design, News, Technology

No Comments


Share this post

Check out this guy’s room totally change into the movie he is watching! No SFX, no post production, no cuts, everything you see here is 100% for real. By Studio OutputFND Collective and MLF. Lovely stuff!!!

Read more

The future of Flash according to the Industry leaders

Innovation, Interactive, Software, Technology, Web

No Comments


Share this post

 

 

Since Steve Jobs posted his “Thoughts on Flash” in April 2010, a lot has been talked about with regards to the future of Flash. With Adobe’s recent announcement that “Our future work with Flash on mobile devices will be focused on enabling Flash developers to package native apps with Adobe AIR for all the major app stores.  We will no longer continue to develop Flash Player in the browser to work with new mobile device configurations (chipset, browser, OS version, etc.) following the upcoming release of Flash Player 11.1 for Android and BlackBerry PlayBook.”, I felt there was one voice we still hadn’t heard from, that of the people in the industry who actually have shaped Flash in the last 10+ years and those who will shape the future. Those who make the work.

50 of the top FWA award winning agencies were contacted by Rob Ford and asked:

After Adobe’s announcement of no more Flash player dev on mobile browser and the hysteria it is whipping up, I thought it would be a good idea to get some thoughts from the people that actually make the work.”

Here’s what they had to say…

====================

Joshua Hirsch, Partner & Minister of Technology, Big Spaceship

I think Adobe could have done a better job of mitigating the negative reaction from the community. They should have anticipated that people would be quick to declare a ‘victory’ for HTML5 and Apple, and that they would use this to bolster the ‘Flash is Dead’ sentiment. The announcement could have been paired with a larger positive messaging effort around AIR as a platform for mobile development, maybe a showcase of apps on various platforms, or demos of exceptional Flash gaming experiences. As it stands, I wouldn’t blame people for wanting to stay away from Flash for fear that it is on its way out.

As far as we are concerned at Big Spaceship, Adobe’s announcement doesn’t have any direct effect on our work, or how we approach it. We think Flash is a great technology, and will continue to consider it as an option, and to use it when appropriate for the project at hand.

====================

Petter Westlund, CCO, B-Reel

Strategically this means a lot, it reinforces the HTML5 and App paradigms. Adobe has it’s reasons to do this, but even if Mobile wasn’t sustainable right now, technology and devices evolve fast. Is closing the door to browser based Flash on mobile the right decision, long term? The other big question is what this means for the desktop platform. Overall I think we as creators benefit from having many options for how to create our projects. Each format and technology has its strengths and weaknesses. I hope we don’t throw out the baby with the bathwater.

====================

Jared Kroff, Creative Director, RED Interactive Agency

The most exciting and impactful digital experiences are those that transcend the technology they are built on to truly connect with and empower the user. Great, mediocre and bad design will always be the same regardless of the underlying technology.

As creative professionals it is our responsibility to master the most effective technologies to accomplish our clients’ objectives. But because it is ever evolving, no technology is ever perfect or complete. As such, the abandonment of any digital platform might always seem premature.

More surprising than the seemingly eminent extinction of Flash is actually how it managed to gain such wide adoption in the first place. Its longevity as a ubiquitous plugin on the web is unprecedented.

The key to the anomaly that is Flash’s success has not been the player, but rather what the creative community has built with the platform. In the end, any technology is only as relevant as the content created for it.

The relevancy of Flash and potential of HTML5 both lie in the hands of the creative community. More importantly, the future of the Internet remains a vast and exciting canvas so long as we seek to continually provide the most engaging and effective user experiences possible.

====================

Mark McQuillan – Technical Director – Jam3

An end to the mobile Flash player was predictable but to end corporate stewardship of the Flex SDK, this is the big shocker for me. Even if it’s just a transfer to the open source community, Adobe is really waving the white flag on Flash. HTML5, I get it, but this has really pissed off a host of creative professionals and i really don’t get the sense this story has completely played out.
====================

Daniel Isaksson, Technical Director, North Kingdom

If Flash keeps pushing the evolution of experiences on internet, as they currently are doing with gpu accelerated video, 2D and 3D I think Flash will be around for some time still. The competition will do Flash good.

We now have more techniques to choose between but we also have a lot more platforms to reach. That’s really good and I wish people would stop claiming there is one solution that works for all.

The need for developing experiences with different techniques for different platforms will keep growing and I see Flash as one of the strongest for desktop experiences.

====================

David Linderman, Creative Director, Hi-ReS! New York

Too Big To Fail?

The future of flash was jeopardized when the iPhone first came out in 2007. Instead of changing tack and embracing the new iOS software, rethinking flash for touch devices and integration on smaller processors, Adobe took Steve Jobs head on in a public battle for who had a bigger dick. Adobe’s strategy from the beginning seemed to be: Flash is too big to fail. Flash was everywhere and Adobe gambled on what they thought would be eventually a simple matter of scale in economy. Apple, as popular as it was, would never single-handedly take down a proprietary “standard” that permeated the web and the industry.

What Adobe should have understood and embraced instead is that the interface memes behind iOS and the proliferation of tablet and mobile browsing was changing the industry, as well as the way audiences consume information overnight.

The first iPad was released just in 2010 (!) and the love for a new and much more intuitive way to browse content spelled the final death knell for flash as we knew it. Flash is still the best way to deliver video or audio content easily over the web to all browsers and platforms, but the ego-driven battle between two titans that started back in 2007 obscured the really issue for Adobe: adapt to new technologies and markets and never ever think you’re too big to fail.

Steve Jobs. RIP.

====================

Cameron Yule, Head of Tech, Preloaded

I’ve always felt that an emotional investment in technology is counter productive, as choice of technology should always be a rational decision based on the needs of what you’re creating.

Adobe’s decision to discontinue Flash Player on mobile browsers should not have come as a surprise. It was an ill-conceived attempt at ensuring Flash remained relevant on mobile devices when Adobe still believed Flash had standing on the web outside of game and video development. In the meantime, forward-thinking developers have instead chosen to support multiple platforms through Unity, HTML5, PlayN, Adobe’s own AIR and many other alternatives.

Flash Player on desktop browsers remains attractive thanks to it’s ubiquity, but it’s now simply one of many available build targets as opposed to a primary development platform.

====================

Wesley ter Haar, Head of Operations, MediaMonks

If we step back from the horrible timing of Adobe’s press-release we’re left with the same discussion we have every single day. What’s the best tool for the job, and how do we reach as many people as possible. Sometimes the answer is HTML, sometimes it’s Flash but in our business being fundamentally for or against a platform or technology means you fill your days squeezing square plugs in to round holes. You look at the problem and you solve it, this discussion about what happens behind the curtain should be left to fanboys & fanatics

====================

Oscar Trelles, Head of Technology & Rob Rasmussen, CCO, Tribal DDB

We focus on creativity and, for over a decade, Flash has been an invaluable ally in bringing our ideas to life.  However, the constraints imposed by today’s generation of mobile devices have been a tremendous challenge. In that context, Adobe’s decision to stop delivering a version of the Flash Player for mobile web browsers comes as no surprise after their announcement to focus Flash on gaming and high-end video, back in October. This will have little impact on what agencies are already doing for clients on the mobile web space, but it drags our attention to the future of Flash on the desktop.

====================

Zeh Fernando, Senior Developer, Firstborn

The more I think about it, the more it makes sense to me. There was never a big reason to have mobile websites with Flash-based content. You could create great experiences with Flash on a mobile website, but it wouldn’t be accessible by everyone, and mobile users are often looking for straight content rather than rich experiences, so the motivation was never there.

AIR was always the strongest market for Flash on mobile, and I’m glad they’ll be focusing on it instead.

On the other hand, in a way, it upsets me that political and economical reasons led to this, rather than technological ones. Considering the amount of innovation Flash has brought to the web over the past 10 years, it’s sad to see it won’t be able to do that on the mobile front.

====================

Joe Corr, Creative Technology Director, CP+B

Our approach to creating work starts with the best way we can communicate our idea and tell our story. We know that our audience connects with us across a variety of devices and channels, and we need to make sure our solutions can meet their needs, wherever they might be, on whatever type of device they might be using at that time.  Right now that limits Flash as a viable option, and makes Standards based work attractive. This debate reinforces our position that we need to be fluent in a variety of technologies so that we are never limiting our greater creative vision.

====================

Firdosh Tangri, Director of Technology, Fantasy Interactive

Adobe’s announcement is a strategic move, more than anything else. They have already been supporting HTML5 by releasing HTML publishing tools such as Edge and Muse on labs.adobe.com. It’s likely that Flash will still be used in the interim to create rich media content until HTML5 fully matures and catches up to the functionality currently offered by Flash. Adobe will continue to support the Flash player for desktop and allow developers to create native applications for the Android and iOS platforms.

====================

David Bliss, Founder and Technical Director, Odopod

Adobe’s recent announcements are unlikely to have an immediate impact on the work we do at Odopod. Regardless of technology, experiences created for mobile devices are different than those developed for personal computers. Developing content and interfaces that work well in both contexts requires additional time and effort and without support for iOS, that additional effort is difficult to justify.

Tools, libraries and methodologies for HTML, CSS and JavaScript are evolving at an incredible pace. Adobe’s decision to focus more of their resources on these technologies increases their chances of bringing much-needed innovation to web design and development processes.

====================

Jonathan Hills, Executive Creative Director & Founder, Domani Studios

Over the last few years the types of interactive video experiences enabled by Flash have allowed storytelling to evolve in an increasingly dynamic and collaborative direction. It almost felt like we were on the verge of a new category of entertainment – something in between Film and Gaming where users “leaned forward” to interact with a narrative unlike ever before. Developers could control this experience by building a framework, or a custom video player, molded to tell a story in a unique way – one where the viewer played an active role.

At Domani we’ve built video players that pull viewer profile data from Facebook and use it to augment the story; we’ve built players that served as a live portal into an event at which viewers can directly interact; and we’ve created video players that enabled users to mix audio and video on the fly. All done relatively easily within the browser.

The tablet is an amazing place for these exciting new video based experiences to live, and there is much that can be done there to make that happen. But without the dynamic options for customization and engagement provided by Flash we risk taking a step backwards from much of what’s made this evolution in storytelling so exciting.

To be clear It’s not impossible to create equally unique and collaborative experiences without Flash. However, its loss means a more rigid framework to build from, and fewer developers able to work within it. This makes such customization not only more time consuming, but also more expensive – and so for many clients less feasible. Non-flash versions of all of this will happen in time, but its hard to not to feel like we’ve taken a step backwards when it comes to creating these dynamic video experiences with relative ease.

Are we now asking users to “lean back” again or can we quickly find tools outside of Flash that allow us to create those immersive “forward leaning” video experiences that we have been creating easily (and for less cost) with Flash

====================

Keith Butters, Chief Experience Officer & Co-Founder, The Barbarian Group

The latest announcements regarding the end of Flash on Mobile browsers could potentially be the end of Flash as a viable option for development in general. This sucks for Flash people who have made careers based on the technology. However, the good thing is, many of those people are genuinely very good at designing interactive experiences, and hopefully won’t have too difficult a time switching to HTML / js/ CSS, or something else entirely. I have high hopes for things like Processing js, and webGL. We could be entering a new period of interactive creativity coming out of these platform changes.

Adobe appears to be banking on AIR as the future of Flash on Mobile. They might be able to pull this off. The trick will be avoiding all the pitfalls of Java / Swing / etc. The whole “write once run anywhere” thing never really worked out for them, with the JVM not working exactly as planned across the different platforms. Can Adobe do better?

====================

Pascal Leroy, Creative Director & Founder, group94

Flash is a wonderful tool allowing to create complex and intelligent, yet slick and fluid interfaces… for the desktop. Because frankly: the small touch screens on mobile devices, to be operated with fingers, hardly allow any niftier interface than a straightforward point and click user pattern. And no need to either. Mobile browsing is about quickly allocating data and to be as efficient as possible. Nobody expects an exciting surfing experience. Apple has banned Flash for commercial reasons, and Adobe seems to have lost this particular battle. Whatever.

====================

Todd Purgason, Executive Creative Director, JUXT Interactive

First off I love Flash, hec I wrote a book about it. At JUXT we were passionate about Flash because it allowed us to be creative, innovate, challenge ourselves and get paid in the process.  In the last two years however, there has been a massive shift that resulted in two very significant realities. First, innovation opportunities for us shifted to iOS, and other large-scale touch projects, in these projects Flash is not a viable option. Second, we stopped getting RFP’s for Flash projects, it didn’t matter if we liked it or not, there has been few opportunities to do business with it. Weather this is right or wrong is kind of irrelevant.

====================

Martin Hughes, Co-Founder, WEFAIL

The future is here! Clients want their sites on iGadgets. They want that ‘cheesy corn snack’ website to reach as many users as possible via the magical (yet rather limited) powers of HTML5. This leaves Flash in an awkward position, you’re only as credible as your latest client, but if clients no longer demand Flash then Flash itself has zero credibility. It’s become the greatest player on the bench. How do we get it off the bench? I don’t know. Ask Adobe, I’m too busy learning jQuery.

====================

Mike John Otto, Creative Director & Managing Director, Hi-ReS! Hamburg

From my point of view it is in a way sad but the right decision. It was a platform I liked a lot for years as it was first choice for creating great work and

entertainment with a lot of potential and I loved using it as for a long time we all created great stuff with that. I don´t want to miss that experience but it was far away from being perfect. However, Flash for mobile is dead and the announcement is a deathblow for Flash in general. Harsh to say but obviously the truth. Nevertheless I agree that this is the time to say so as the web should be all access and open and there is no space for a vendor that controls the platforms we work with – HTML and HTML5 or Javascript are open technologies that don´t bind us and that´s the way the web should be – maybe a thought to discuss as well for the hardware we use ;)

====================

Stefan Thomson, Head of Digital Innovation, Forsman & Bodenfors

For us creatives, Flash has opened up lots of possibilities from the very beginning, and it almost rewrote the whole way we thought about the web.

The mobile flash plugin got a bit of a buzz in the beginning, but the same revolution never took place, mainly because of performance issues.

We never work on an idea based upon any specific technique or platform. Our mission is to use the technique that best brings our ideas to life.

For us,this has almost always meant creating a native application for Android or iOS, or creating a HTML5 website to gain as much reach as possible.

====================

Drew Ungvarsky, Owner & Creative Director, Grow Interactive

While I question the motives of the Flash vs. iOS debate, I’m definitely excited about the types of innovation the change has inspired, not to mention the focus on usability. Like everything else in development, the conversation should be about using the right tool for the right result. Worth noting is that Flash still does things that HTML is incapable of (and not to mention at a substantially higher adoption rate on the desktop).  For those things, it’ll be the right tool until something better comes along.

====================

Josh Rhode, Creative Director, Tribal DDB

Flash pushed the limits of experiential digital design and ushered in some of the most impressive and innovative sites ever seen. In adecade of lackluster and often terrifyingly inconsistent HTML browser standards, the universal framework and interactive capabilities that Flash offered were light-years ahead for creatives. HTML5 is still barely catching up, and its pioneers can thank Flash for having given us the ability to set the benchmark for all of these years. As brands head further into web-based products and services, Flash’s toolset still provides designers the best way to prototype ideas and rapidly visualize concepts.

====================

Julien Terraz, Creative Technologist, Digitas France

Flash is always compared to HTML, but most of non-developers can’t really get what differs between them, so to make them understand I often say : “Flash and HTML are like men and women, they are from the same species, they are made to live together but are very different from each other : HTML is a respected man, loyal and elegant wether Flash is a smart and innovative woman but often underestimated.

====================

Jimmy Herdberg, Creative Director & Owner, Kokokaka

The idea is king, then we find the best technique to realize it. And to reach the users. Today you reach about 50% of the users with HTML5 comparing to with Flash where you reach around 99%. These numbers change very rapidly and at the moment we’re going through a transitional phase as HTML5 becomes more popular. It’s important for us to reach all plattforms: desktop, tablets and mobile. But Flash is still the master tool for interactive music!

====================

Melissa Camero Ainslie, VP of Innovation & Platforms, AgencyNet

Remember 5 short years ago? HTML table layouts, spacer gifs and alternate stylesheets? We don’t either. Back then HTML was a pain in our creative side. Flash was the solution — a cross-browser platform that allowed us to build and animate and create anything our designers could dream up. Then the iPhone hit the market and we all know what happened. HTML evolved and now affords us the same kind of freedom Flash used to. Sure Flash still has its place as a cost-effective platform to create simple videos, banners and games, it just doesn’t make sense for today’s socially-connected, multi-platform experiences.

====================

Marc Storch, Senior Flash Designer, Scholz & Volkmer

Flash as a plugin will hopefully disappear from the mobile world because its simply not made for it. As a development tool Flash has turned the web into what it is today.

It combines the worlds of design and development, animation and applications and has opened many doors for countless people in the creative industry. It still does. Due to Adobe’s good work on the flash packager for mobile devices, Flash developers don’t have to be afraid. Its a metamorphosis. Like the web is – of a good kind.

====================

Johan Belin, Creative Director, DinahMoe

It is thanks to Flash that we are even talking about “rich content”. It has been a marvelous platform for experiments with interactive storytelling, combining text, stills, animations, 3d, video, sound and interactivity into one uninterrupted experience. But the world has changed, tablets and mobile devices are more and more becoming user’s primary (or only) media device. Flash is not ubiquitous anymore. Adobe gave up on mobile devices, is moving resources from Flash to HTML5, and will eventually let it die altogether. It feels a little sad to be honest, I have had a really good time!

====================

Ian McGregor, Senior Developer, Stinkdigital

Last week’s announcement and the resulting hysteria was embarrassing. Embarrassing, awkward and unsettling. But Flash is not dead yet.

In recent months I’ve witnessed a strong resurgence in excitement and confidence around Flash following some great advances and improvements.

There is however a very serious perception problem. There’s no doubt that the manner in which Adobe communicated their plans has been an unmitigated disaster.

My advice is to keep calm and carry on. Try to stay technology agnostic, selecting the best tool for the job. In many cases that may well still be Flash.

====================

Owen Wallis, Head of Production, Less Rain

At the start of 2011 it wasn’t looking great for Flash, we all thought we’d have to get new day jobs! Then Apple opened up its restrictions on porting Air apps onto iOS. This really changed the game for us. In the past we’d have to create one Flash codebase for online, then create a seperate natively built version for iOS and other mobile devices. Now we can build once in Flash then port to iPad, Playbook, Tablet S – wherever we like. The UK marketing and evangelist teams from Adobe have been really positive in giving us help and support. The fact that there is no more Flash player development on mobile is not really an issue for us, as we can now deliver our content in App form.

====================

Svante Hellberg, Senior Interactive Director, ACNE Production

Right now, we’re still using Flash as the major technology in most of our productions. This is because right now Flash has a great user penetration, and runs the same on all major platforms, except Apple mobile devices. And it’s still the best and most reliable technology in terms getting a real high-end finish. For example in video, font and sound handling/manipulation.

However, the time has come for Flash to take a step back and let HTML5 (with js, css3 etc.) take a larger place. But I don’t think people should blindly take a stand for either HTML5 or Flash, they should try to get a deeper knowledge in which technologies are best suited for their project.

====================

Vincent J. Higgins, Experience Design Director, Tribal DDB

Personally, I think the discontinued development of Flash is a little premature. Like all first and second generation devices they startwith basic hardware and software that overtime becomes more powerful, effective and robust. With the introduction of quad-core smart phones and tablets it seems that the required technical power to run flash is catching up.

Did Adobe discontinue it’s development too early… Would 1 more year make the difference? This remains to be seen but a Mobile Flash player 12 optimized for a quad-core table/phone sure seems like a good idea – unfortunately I don’t work for Adobe.

====================

Anders Sønderby Jessen, Lead Developer, Hello Monday

Adobe’s announcement to stop developing the flash player on the mobile platform may have surprised the developer community, but it was also to be expected. More important, however, is the overall shift in focus on Adobe’s part from flash/flex to HTML. In their own words: “In the long-term, we believe HTML5 will be the best technology for enterprise application development.” (http://blogs.adobe.com/flex/2011/11/your-questions-about-flex.html). >

Flash, as it exists and is being used today, will slowly die out, as it already has for many sites that have a long life expectancy. Because of browser inconsistency Flash is still currently – and will continue to be for quite some time – the best tool for creating engaging, video-rich, experience-driven campaign sites. But HTML is growing up fast and will, within the next few years, become Flash’s successor even in this field.

====================

Jort Schutte, Art Director, Achtung!

As an agency that focuses on developing creative concepts and design we always try to push the techniques forward and not to being pushed back by technical limitations. The beauty of Flash is that almost everything is possible. The alternative: HTML 5 has not (yet) the capabilities that flash has. It would be a shame that in the future we should take technical limitation in to consideration while thinking of new ideas. But to go forward you always need to take a step back and open source is always better than a closed plugging. We go with the flow.

====================

Nobuaki Arikata, Flash Designer, Birdman inc.

Until now, Flash has been used as Rich internet application tools for many great sites, but, the appearance of HTML5 and CSS3 has now taken its place and Flash will end its position of “Rich animation tool”.

However, the appearance of Flash Player11 will change the usage of Flash Player from “what you look” to”what you experience”, by the support of GPU acceleration. With Flash Player 11, you can now develop web content that’s the same quality as PlayStation or Xbox by using GPU.

Not to forget, Action Script is a language that is very easy to use and develop, so it is a very useful tool to develop applications quickly and easily.

Flash experience will be dramatically improved, since Flash is now apart from mobile devices for good, and now can concentrate its target on PC.

====================

Michel Bianco-Levrin, Owner & Creative Director, Diplomatic Cover

Flash is the only platform that has managed to bring together designers and developers, and it’s already a miracle! With these two players together around this techno-creative platform, everything is possible! HTML5 is synonymous with accessibility, readability, but Flash rhymes with entertainment, experience and innovation. The web will have these two aspects as long as quality content will be present. For us to animate a web that could quickly become boring.

The Flash industry is intimately linked to the creatives and to the developers’ ambition. We have to keep this industry in the right place! After each loader, you will have to be surprising!

====================

Henry Chu, Creative Director, pill & pillow

We love Flash, but it must evolve. We are sick of hacking Flash to do what HTML does natively.

====================

Rick Williams, Creative Development Director, AKQA

For AKQA, it’s still about using the right technology for the right purpose and it always has been. What we are seeing is a move towards publishing some of our mobile experiences to different mobile platforms using one solution such as PhoneGap or AIR, rather than building a native app from scratch each time. Flash Builder will continue to play a significant part in the digital creative landscape for us. There are ideas which simply can’t be done with any other technology as easily right now and we feel this is going to be the case for quite some time.

====================

Dimitry Loffe, CEO & Founder, The Visionaire Group

As technology continues to evolve, so do our media consumption habits. Although it won’t happen overnight, Flash could easily find itself in a similar position as CDs and DVDs; the VHS of today, based on the current crescendo toward mobile. At The Visionaire Group, our goals are to provide the best possible solutions for our clients forging into tomorrow be it flash, HTML5 or beyond.

====================

Errol Schwartz, Senior Interactive Developer, Rokkan

Adobe’s announcement was not a shock to us at Rokkan and won’t affect our development strategies in any way. We were never targeting mobile devices as Flash platforms beyond the occasional AIR app. Websites are becoming more about usable presentation of content, and less about the entertainment value that Flash sites were previously providing. People are looking to mobile for everything these days, including fun interactive experiences. Native mobile development was always the clear winner when thinking about performance and using a device to its full potential.

====================

Raul Uranga and Edgar Ortiz, Flash team leaders, GrupoW

We think that Flash is here to stay. It is a great tool to develop creative content and we do not think that has come to an end. Certainly, there have been some disturbing news lately about Flash Player in the mobile environment and we think that it all comes down to interpretation and communication.

Adobe is a leader in multimedia and if HTML5 is a new way to express creative ideas, they want a big piece of the action.

Flash is a great tool, it has shown its potential in many fields, it has a long history behind of proving that it works for any idea we had in mind, and as almost any tool in this business, including HTML, it has flaws too.

No one is pushing no one aside, all of these tools are there for you to use them, use the one that fits your needs and get the most out of it!

====================

Pete Golibersuch, Director of Visual Design, Tribal DDB

Concepting for mobile requires creatives to be cognizant about technical limitations. What percentage of the population is using a given mobile platform? What is the market penetration of current gen handsets? How byte-heavy will the intended experience be? Does the idea line up with mobile use scenerios? In almost all cases, this exercise will shape the creative in a such a way that doesn’t require Flash, even if it were available.

Adobe announcing the end of Flash on mobile really has little or no impact on the work we do in that space.

I’m interested in seeing if Adobe can successfully pivot, perhaps providing better standards-complaint development tools or extendingtheir AIR platform in a way that allowed the creation of platform native apps.

====================

 

[Via theFWA]

Read more

Add value with custom QR codes

Apps, Innovation, Interaction, Interactive, Mobile, News, Software, Technology, Web

No Comments


Share this post

QR Codes are the easiest way to transform your analogue marketing into digital, and QR Codes can be the medium that connect your brand with mobile audiences out there. They represent a new communication channel that everyone can afford and they can be easily implemented alongside your current marketing activities. Their huge advantage is the low budget that is needed to enter into the space of mobile communication.

We live in times of mobile and social networks and information has never before been so available and so easily accessible. Everything is going mobile and you should consider how to prepare your future marketing strategy with mobile channels in mind.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

The Smart phone market is growing faster than any other market and by 2014 mobile web usage will overtake desktop web usage. Brands and businesses are learning how to leverage their campaigns to engage with mobile audiences via QR Codes. The incredibly fast changes we see today are empowered by the communication revolution and you will either catch it or will be left out.

Example

Let’s say your local pub have regular stand up comedy shows on Thursdays and parties on Fridays. For these two days your QR Code can be linked to some different content then automatically revert to the default one. If this is a repeating event then this approach is far easier than setting up a new code or editing its link every week. Normally, the QR Code should be connected to a mobile web app to get more info about shows, events, artists, submissions.

 

Qrcode-platform-qrcode-generator-and-mobile-apps1-500x302

 

Great example how QR Codes can add value!

Tesco / HomePlus is a South Korean grocery chain and they utilized this amazing subway QR Code grocery store in Seoul in February 2011. This is very elegant and peppered with creativity and forward thinking solutions. It is simply one of the best uses of QR Codes in e-commerce in the world so far.

How QR scanning works

First, you need to go to your smart phone marketplace (Apple store, Android marketplace, Windows phone marketplace or Blackberry marketplace) and search for QR Code reader. Most of these QR Code readers are free applications. Then just open the app and start scanning. This is the list of best QR Code scanner apps.

 

How-to-scan-qr-code

 

Mobile apps

Connecting a mobile audience via QR Codes should include an optimized mobile web site. QR Codes offer a quick way to connect to your online information for people that are constantly on the move. The majority of them have now have a Smart phone and they don’t need to type a URL into the mobile browser which is a huge time saving and less error-prone way to access information. When they take the effort to take out their phone and scan the code they get all information loaded into their mobile phone browser. When the user has loaded the whole web page into the mobile phone browser they just don’t know what to do: scroll left-right or vertically to view all the content on that page, there is so much information that isn’t relevant and it takes too much bandwidth. At the end of the day this is not the most efficient way for someone to experience your brand, service or other information on a mobile phone. So, you need optimized content that is easily browsable on smart phones and that is exactly what we are providing.

Think mobile
Think how you would feel if someone gave you 100 books and magazines instead of only the publication you asked for. Using generic desktop web pages a QR Code campaign landing page is far from what smart phone users expect to find when scanning the code and in reality poor mobile experiences or connecting a QR Code to desktop web pages is still the Number One mistake made by QR Code advertisers.

Enhance mobile experience with mobile optimized landing web page
An effective landing page should engage potential customers in a positive way. Creating a branded optimized mobile web app that work across all phones and tablets can dramatically increase mobile experience and most importantly your bounce rate can be much more efficient.

Within Esponce QR Code Platform you can integrate proper mobile experience and create mobile web apps that are cross devices/OS platform optimized.

You can enhance your mobile experience with rich mobile content, prize contest, portfolio and social channel integration and custom landing page that can change the way you market your real-world promotions in mobile space. Without a properly delivered message, you can’t expect that people will take any action!

Check out the complete list of features >

 

How to create custom QR Code?

Designing custom QR Codes is an Art of it’s own as a designing cool and readable code is not an easy and quick thing do to. One way to enhance the black and white code is to add and overlay your graphic. With this process you can simply sign off your codes with your logotype, image, or graphic. With this QR Code platform you can do just that. You can simply integrate your logo or graphic into the QR Code and you can use live indicator to see if the Code is readable or not.

 

Qrcode-generator-500x413

 

80+ gallery of custom QR Codes

Here are a few hundred custom codes generated by brands and business, government, non-profit and individuals… There is no doubt that QR Code technology has penetrated in all sectors of our daily life.

Take a look this unique 80+ gallery of custom Codes from Orange- telecommunication company to FEMA (US. Department of Homeland Security).

 

[Via Avivo]

Read more

The Man Who Thought Differently, Stayed Hungry & Stayed Foolish

Creativity, Innovation, Inspiration, News

No Comments


Share this post

werk

27.100 videos on Steve Jobs: Click here to watch videos

Read more

Björk’s new album as a series of iPad apps

Apps, Creativity, Innovation, Interactive, Mobile, News, Software, Technology

No Comments


Share this post

The ever innovative Björk has created her album as a series of iPad apps. The result is a bundle of interactive art, entertainment and audio content that sets a benchmark in how artists can use technology. Read more here and here

Read more

Who do you want to be today? Realtime face substitution is awesome!

Animation, Campaign, Creativity, Innovation, Interactive, News, Software, Technology, Usability, Web

No Comments


Share this post

 

FaceTracker is a C/C++ API for real time generic non-rigid face alignment and tracking.

Goal:
Non-rigid face alignment and tracking is a common problem in computer vision. It is the front-end to many algorithms that require registration, for example face and expression recognition. However, those working on algorithms for these higher level tasks are often unfamiliar with the tools and peculiarities regarding non-rigid registration (i.e. pure machine learning scientists, psychologists, etc.). Even those directly working on face alignment and tracking often find implementing an algorithm from published work to be a daunting task, not least because baseline code against which performance claims can be assessed does not exist. As such, the goal ofFaceTracker is to provide source code and pre-trained models that can be used out-of-the-box, for the dual purpose of:

1. Promoting the advancement of higher level inference algorithms that require registration.
2. Providing baseline code to promote quantitative improvements in face registration.

Features:
• Real time: ranging from 20-30 fps (depending on processor, compiler and use of OpenMP)
• Generic: designed to work for most people under most conditions
• No training required: a pre-trained model is provided
• Detection based initialisation: no user intervention required
• Automatic failure detection: requires no user re-initialisation
• Camera or video input

Download:
FaceTracker is available for download (for research purposes only). The library includes the C/C++ API, example code for interfacing with the API, a pre-trained model and documentation. To download it, please send an email to Jason Saragih(Jason.saragih@csiro.au).

The Tracker:
The code requires OpenCV 2.0 and the provided model was trained using the MultiPIE database. The tracker is based on a modified version of the constrained local model described in:

J. Saragih, S. Lucey and J. Cohn, “Deformable Model Fitting by Regularized Landmark Mean-Shifts”, International Journal of Computer Vision (IJCV)

People Using FaceTracker:
Some people are using FaceTracker to do some really cool stuff:

• FaceOSC
• A music Video!
• Face Projection
• Being John Malkovich
• pkmFace

Videos:

Follow this link to see some examples of difficult YouTube videos that were processed using FaceTracker with the pre-trained model. There was absolutely no user intervention in any of the videos.

[Via FaceTracker]

Read more

The future of Flash

Campaign, Innovation, Interactive, News, Software, Technology, Web

No Comments


Share this post

For a number of years Flash was the most in-demand skill within the digital design industry, but with the rapid growth of new platforms, which don’t need Flash to operate, we are seeing less need for it.  Over the past year at Source we have only had around 11 or 12 full-time Flash designer roles, out of around 200 jobs in total.  However, we are still receiving freelance bookings from clients for Flash banner designers and coders. These are mainly from production agencies, or agencies that are at the production stage of a project. More and more though, our clients are producing projects using HTML 5, which is starting to become the default.  HTML allows you to be more dynamic with your designs and coding, whilst looking and working equally well on all platforms.  FWA (Favourite Website Awards) is still showcasing some of the world’s best Flash projects which continue to inspire us all, however as we know Apple’s iPhone doesn’t support flash, and Apple are currently leading the way with how the future of design will be.
Interestingly projects which involve design for kiosks, digital escalator panels, interactive bus shelters and other touch screen applications still use Flash, as it works well with ActionScript, Papervision, Away3D and augmented reality solutions.Salaries for people with Flash are no higher or lower then other types of designers or developers.  Flash designers and coders can expect the following salaries:

Junior Designers/Flash Designers £18k-£25k £150pd- £200pd
Mid/w Designers/Flash Designers £25k-£38k £200pd- £250pd
Senior Designers/Flash Designers £40k-£55k £250pd- £325pd
Junior ActionScripters £18k-£25k £150pd- £180pd
Mid/w ActionScripters £25k-£40k £200pd- £250pd
Senior ActionScripters £40k-£60k £250pd- £400pd

 

Does Flash remain a key skill worth training in? Read on for opinions from some of the industry’s thought-leaders:

“Flash is a flexible set of tools that offer easy multimedia capabilities and entry points at all levels of ability. In our prototyping we strive to use the best tool for a certain job, not just the tool that we know best so I’d say that Flash definitely has a future but it is not the only technology around. It has the advantage of being present in one form or another on many mobile devices and as such is a valuable skill to have but it needs to form part of a portfolio of skills – I would want to see it partnered it with javascript & HTML or Qt Quick & C++.”
Alistair Wharton – Design Technology Lead – Nokia

“Given that HTML5 is pretty damn good already – I would rather not be a flash developer when it gets up to HTML8”.
Will Cole – Creative Director – Maverick Media

“Flash is still used, but sparingly it seems. Gone are the days when agencies like ourselves would deliver flash site after flash site. There is so much you can do without flash now, and there’s a big emphasis on accessibility from most clients. However, it’s still a useful tool when delivering specialist products, and I would say its a skill that’s still needed, albeit less frequently – I mean someone out there still needs to know Flash right?”
Will Pyne – Owner – Holler London

“If you’re looking for a digital design career more focussed towards advertising flash is still a useful skill set to have as it’s still the standard application for online advertising production. But, if your focus is larger scale website design flash is definitely in demise because of increased web standards and brands looking to produce SEO friendly, accessible online experiences. Add to this the emergence of mobile and tablet devices, particularly the iPad which doesn’t support flash and you’ve got some pretty big reasons for flash moving out of favour.”
Anthony Oanes – Associate Creative Director – Lbi

“Flash is still one of the ‘tools of the trade’ for any online designer and being installed on 98% of internet connected browsers it is still a valid piece of software.  At Disney we are trying to reduce the heavy reliance on Flash, finding alternatives to create a more efficient, optimal and accessible multiplatform user experience. Much of Flash’s simple interactive content can be replaced by an alternative code-base such as HTML5, but it still leads the way in regard to online casual gaming, video streaming and short-form animation where it will still remain the ‘go to’ piece of software for the foreseeable future.”
James Bruce – Head of Creative – Disney EMEA

“There is no doubt that the future of flash on mobile devices has been put into perspective with the recent Apple iPad announcement.  But, Flash has always had a minor slice of the digital content pie – after all, flash driven sites only account for a fraction of online sites – and this share is likely to continue to shrink.  Recent projects we delivered in a subset of HTML5 have demonstrated real potential for rich web experiences – some of which are arguably more accessible (no plugin required), possibly less processor intensive and platform independent.  Ultimately, if Flash were to go extinct, as a creative I would miss the flexible and intuitiveness of its script and timeline based interface.”
Yann Caloghiris – Head of Film & Video – Navyblue

“10 years ago Flash was the creative saviour of digital creatives, they could finally make pretty, interesting and interactive applications.  But the digital technology has moved on. However with the arrival of HTML 5 and the number of platforms that support HTML5 instead of flash, I certainly wouldn’t call Flash a generalist digital skill set anymore.   I’m not only referring to Apple’s reluctance to support flash. The biggest emerging technologies like WebTV and Mobile won’t be using flash.

Flash has already become a niche product and it will continue to have a niche market for a few years to come e.g. in some types of PC based gaming.
It will soon become a speciality like Adobe Director: perfect if that’s your game but it won’t be an ongoing requirement for advertising and marketing agency creative staff.  Last year I would’ve insisted that every digital designer have some flash experience e.g. for building banners. But in a year’s time this will no longer be a required skill set for digital creatives.”
Leroyson Figueira – Digital Creative Director – Haygarth

“Flash is essential to a huge amount of digital activity – and irrelevant to much more. As an animation tool, it’s not that sophisticated. It has issues with accessibility. It tempts designers into thinking they’re movie makers, forgetting the attention span of web users.  But because it does what it does so well, it going to be around a while longer.  We use flash in our work because it offers such a handy mid point between the back and front ends – between the data and the eyeball.  It’s been around long enough to be just about the only guaranteed cross platform and browser language.  It just works – and that counts for a lot.  But the big question here is ‘What happens when Steve Jobs dies?’ His feud with Adobe and refusal to include flash for the iPhone and iPad has started all this anxiety. As well as drive the demand for Android phones that have no such inhibitions.”
Matthew Maxwell – Digital Creative Director – Draft/FCB

“For the next few years there won’t be a technology with the penetration and features of Flash. As time goes on, simple Flash applications, banners and games will be built using HTML5 and Flash will be used to create mainly complex and rich applications. There is some amazing work in HTML5 largely created by Flash Developers, such as Mr Doob and Seb Lee-Delisle but HTML5 is still much less developed compared to Flash, especially from a programmer’s perspective.

Learning Flash Development is a great introduction to programming plus it’s very easy for a Flash Developer to learn other similar languages such as Javascript for HTML5, Objective C for iOS or Java for Android. Flash Development will be a valuable skill for the next few years and maybe beyond, but any good developer is not tied to one language. At Kitcatt Nohr Digitas in London and Digitas in New York, our Flash teams are starting to work in HTML5 and iOS as the skill sets are so similar.

I would say anyone getting into Flash Development now should also be coding Javascript and looking at the other new technologies that excite them like Open Frameworks or Arduino. No one knows what technologies we will be using in 3 years time but the skills that you learn as a Flash Developer equip you well to hop technologies as things evolve.” Alistair Colling – Technical Manager – Kitcatt Nohr Digitas

[Via wearesource.co.uk]

Read more