by Lidia Paulinska | Jun 13, 2016
Embedded Vision Summit, May, 2016 – Marco Jacobs from Videantis talked about the status, challenges and trends in computer vision for cars. Videantis, which has over 10 years in business, is the number 1 supplier of vision processors. In 2008 company moved into the automotive space.
What is a future of transportation?
Definitely we will be travelling less than today. Typically less than 100 miles in a day. The only autonomous people mover today is an elevator. So, when can we expect autonomous cars on our roads? At CES 2016 the CEO of Bosch answered – “Next decade maybe”. For now we have low speed and parking assistance but highway, exit to exit… around 2020.
The autonomous vehicle development is described in levels that range from L0 to L5. Today in production are levels L0, L1 and L2. L0 is where driver fully operates a vehicle, L1 is where the driver holds wheel or controls the pedals and vehicle steers or controls speed. Finally L2 is where the drivers monitor, at all times, and vehicle drives itself but not 100% safely. Level 3 needs R&D and L4 and L5 is when the paradigm changes.
How does the market look in numbers?
There is 1.2B vehicles on the road, 20 OEMs produce over 1M each year, 100M cars sold each year, 100 Tier 1s creates over $1B revenue ($800B combined), and less than $1T business excluding infrastructure, fuel, and insurance, around 25% of the cost is electronics.
Today, new cars also carry 0.4 cameras. There is an opportunity to increase that number to 10 cameras per car to extend visibility. In L0 vehicles there are rear, surround and mirror cameras. In L2 and L3 there will be rear, surround, mirror and front cameras.
Rear camera functions typically included: wide angle lens, lens dewarp, graphics for guidelines, H.264 compression for transmission over the automotive in-car Ethernet. Vision technology allows for real-time camera calibration, dirty lens detection, parking assistance, cross traffic alert, backover protection and trailer steering assistance.
The surround view typical functions include: image stitching and re-projection. Vision technology in this application offers: structure from motion, automated parking assistance such as marker detection, free parking space detection and obstacle detection, including everything that rear camera vision functions include.
Mirror replacement to cameras on vehicles will reduce drag and expand the driver’s view. Its typical function include: image stitching and lens dewarping, blind spot detection and rear collision warning. Vision technology offers: object detection, optical flow and structure from motion, as well as the basic features found in rear cameras.
Typical function of a front camera that provides control of speed and the steering wheel are: emergency braking, auto cruise control, pedestrian and vehicle detection, lane detection and keeping, traffic sign recognition, headlight control, bicycle recognition (2018) and intersections (2020). Drive monitoring that is in L0 has features as such: driver drowsiness detection, driver distraction detection, airbag deployment, seatbelt adjustment and driver authentication. Vision technology offers: face detect and analysis, as well as driver’s posture detection.
Here is the image processing pipeline:
The speaker mentioned and discussed the challenges like work under all conditions: cold & hot: low power; dark & light: HDR, noise; dirty lens; detect angles; operating over a speed range of 0-120mph: the need to select different algorithms; car loaded/dinged: calibration. Challenge is also working under severe power constraints such as: power source 100W, small form factors limits heat dissipation or complete smart camera less 1W. Another challenge is: what is the better option: centralized or distributed processing, as both have pros and cons. Pros for central processing is that single processing platform eases software development but the cons are: entry-level car also needs high-end head unit; it is not scalable and not modular; adding cameras causes system overload. Distributed processing seems to have more pros such as: low-end head unit, options become plug-and-play, and every camera adds processing capabilities. But the cost is: the system is more complex. The reality today is that some cars have 250 ECUs.
Jacobs’s final conclusions were: the business opportunity is huge (>$1T), self-driving car tech causes paradigm shift (new players can grab market share), automotive is not like consumer electronics, next 10 years no self-driving cars (change will be gradual, lots of driver assist functions with vision technologies; efficient computer vision systems are the key enabler for making our cars safer.
by Lidia Paulinska | May 30, 2016
Just two more weeks until the Electronic Entertainment Expo (E3), the world’s premiere trade show for computer and video games, that is being held at the LA Convention Center. More than 20,000 attendees are expected, many new products and announcements but also for the first time the fans and enthusiasts of the electronic entertainment can be a part of that exciting event. E3 Live will be situated at Downtown Los Angeles’ sports and entertainment district of the city and will be open to the ticketed public.
E3 and E3 Live will be taking place from Tuesday, June 14 till Thursday, June 16. Before the doors open for the show let get a glimpse at the state of the industry.
Games industry is the fastest growing sector of the modern entertainment industry and is part of modern culture. Today game enthusiasts expect a richer, fuller and more involving game experience. Under such demanding clientele, more dynamic and multidirectional developments of games have been created, and the pallets of emotions both in the game and experienced by the player, have been greatly increased. Production studios strive for authenticity and put meticulous attention to detail, bringing players into a new level of realism, which may include 3D technology that changes flat images to three-dimensional images and cinematic quality photo-realistic events. Today’s game has a story line, utilizes state of the art visual graphics and utilizes new, advanced form of interaction with the player. In addition there is also increased proliferation of artists in the games industry, who get to express themselves creatively and individually. The impact of the games on mass culture is unquestionable and its value is growing at a dynamic pace.
The big attraction this year is the realization of the hype created by the Virtual Reality (VR) products. Not only is VR in a number of new platforms from companies like Oculus, Sony, Samsung, Razer, HTC and others, but the show will feature a full VR ecosystem. Accessories for controlling the game, walking around and being fully physically immersed in the game, new sensors, games from major publishers and companies as well new experiences from independent developers.
The other major attraction at the show is the availability of accessories and peripherals for the new consoles and high performance PCs released in the past couple of years. The accessories – charging devices, extension cables, headphones, and controllers, performance accessories such as CPU & memory coolers, and skins /decorative items take a little bit to develop after the platforms are released, as they require the software titles to make their market entry before the user community makes the commitment to adopt the large variety of branded items.
The industry topped $131B USD in sales covering the hardware, software and accessories marketplace.
More info at http://www.e3expo.com/url_takeover
by Lidia Paulinska | May 28, 2016
SID Display Week, May 2016 – Digital signage is used to entice and influence shoppers on their way to the retail stores and shopping malls. Tablets that replacing paper menus, allow restaurant patrons to preview and customize their orders. Engaging visual displays are revolutionizing leisure experiences, promoting increased consumer engagement as e.g. instant replay. Digital signage is a modern communication tool.
At the business session at SID Display Week the presenters: Sanju Khatri, Director of Digital Signage from IHS, Jennifer Davis from Leyard, Karen Robinson from NanoLumens and Paul Apen, Chief Strategy Officer of Eink gave broad overview of digital signage applications that is ambiguous communication tool of our time.
Sanju Khari mentioned needs of outdoor and high-brightness indoor digital signage applications. To address direct sunlight and heat load outdoor displays need to be >2000 nits of brightness, for indoor 1000 nits or higher. Brightness of LCDs can be further enhanced by adding LED backlights and increasing power consumption. However as LED backlights age, they provide fever inputs per watts of power. Cooling mechanisms are essential to maintain lifetime of displays. IP 64 and IP 65 rated. To address harsh and changing weather conditions outdoor displays need to withstand heat, humidity, snow, rain, wind, dust, fumes and dirt. Scratch and impact resistance properties of cover glass is important for both high-brightness indoor and outdoor displays set in high traffic areas. To address heavy usage cycle and vandalism digital signs placed at public settings need additional protection of cover material such as glass or polycarbonate. Important need is also serviceability. Down time of publicly placed outdoor or indoor advertising displays result in negative advertising revenue. Quick turnaround in service and display modules being accessible for on-site repair and maintenance is extremely important.
The Digital Signage market in numbers is growing as well as its revenue:
The direct-views LED video displays by pixel pitch in categories of area (square meters) and revenue are portrayed in stats below.
Jennifer Davis from Leyard described the market requirements for digital signage as simple words: Impact and Value – cost effectiveness to the outcome. Those include the features as: seamless (or close to it as they can afford), highly reliable for long-duty cycle applications (all day to 24×7), bright enough and wide enough color to have brand impact, good value.
What are possibilities at LED market?
No doubts that the LED market is expanding, less than 1.9mm pixel pitch grew 279% year in 2015, as well as this area visibility at the related shows such as: ISE, InfoComm China, where more fine-pitch LED offering and vendors were showcasing. The falling costs with the price elasticity makes market growth for LED. Led now is 13% more than rear-projection cubes and 7x the cost of tiled LCD. Down from 200% and 21x two years ago. Davis stated that future grown will be determine by innovations and market maturation.
Karen Robinson from NanoLumens shared her view on current generation that is driven by passion for social media that allows sharing and viewing video. As digital signage is an ambiguous communication tool: displays TV are rising in quality, not just quantity; mobile phone displays continue to improve and Dooh has shifted from vinyl wrapped boards to vibrant LEDs. Display driven generation demands that smartphone and tablet adoption have added new screens. Just as a reminder – in 2000 it was not possible to stream video over a phone. By 2018, over 2.5 billion consumers will enjoy ability to stream video on their smartphones as well as 1.5 billion tablet users worldwide by 2019. Today the average household has 5 or more video-enabled devices. Traditional signage, billboard and display advertising is rapidly shifting to digital and has changing the way we eat, shop, work, play and the way we live. By auto profiling customers and their expected behaviors ahead of their actual presence vendor can quickly customize and personalized the content. Displays become more interactive. Robinson presented few digital displays from worldwide that perfected to create engaging and immersive experiences: American Airlines Arena in Miami, Florida; Holt Renfrew in Ontario, Canada; Mac Cosmetics store in Waikiki, Honolulu, Hawai; Pacific Fair in Broadbeach, Australia; Sport Chek in Toronto, Canada; Telstra in Sydney, Australia and T-Mobile store in New York City, NY. Those examples combine four areas: Architecture, Information, Advertising and Art – she stated.
Paul Apen, Chief Strategy Officer of Eink talked about alternative signage that is ePaper. That display allows outdoor readability, unique form factors and off-grid installations. He stated that it can be used in many areas such as: transportation, conference room, public spaces or retail. The effective signage design should also complement its environment as ePaper does.
Dynamic content management is next thing coming. There will be more relevant content directly to shore, location, and customer. Also economics of the business is allowing the prices to go down. That is the trend now.
by Lidia Paulinska | May 22, 2016
April 2016, NAB – At the start of NAB, SMPTE held the Digital Cinema Summit. The highlight speaker was Ang Lee who spoke following a discussion that HDR was not a tradeoff for future films, but was a technology that must be adopted due to its benefits in the story telling and immersive aspects of films. He spoke on pushing the limits of cinema.
One of the examples was with his film “Life of Pi”. In this film, the story is the enticing element. One aspect of the story was how to visually represent an irrational number and bring it to the screen as an experience. The film used 3D as an extra dimension in this story telling. HDR and HFR are also new technologies that can help with the story telling. HFR (High Frame Rate) has been under a recent resurgence as an alternative the traditional 24fps, and have been championed at NAB and other events by Doug Trumbull. Doug has been advocating 120fps content for both 2D and 3D films. Doug’s latest workflows include cameras, servers and editing flow for support of 3D, HDR, and 4K all at 120fps.
The workflow has over 40x the data of standard film, but produces an entirely different cinema experience. At NAB they had previews of an 11min clip of Ang Lee’s new film ‘Billy Lynn’s Long Halftime Walk,’ that was shot in 4K, HDR, 3D at 120fps. The preview was shown using dual Christie laser projectors and standard surround sound.
The clip provided an exposure to a new level of a “clarity of image” that has not been seen before by cinema audiences. This clarity of image defines a new challenge for the storyteller to be able to utilize this technology and enhance the story being told. The HFR feature also brings new cinematic capabilities to both 2D and 3D films. The HFR aspect also brings a new level of brightness and smoothness to the playback which can be used to enhance cinematic emotions and action without causing viewer fatigue. The overall common experience of the audience after viewing the clip – mostly related to technology and secondarily the cinematic use of the technology was “WOW!”.
by Lidia Paulinska | May 22, 2016
April, NAB – At the end of the day, the market is more and more competitive and we need our customers not only survive but also thrive – stated Charlie Vogt, CEO of Imagine Communications (IC), moderator of the power session “Transformation 2016: Media Technology Using IP, Cloud and Virtualization”. The session that took place at the Imagine Communications booth during NAB show, was featuring the panelists: Antonio Neri, EVP/GM, Enterprise Group, HPE and Steve Guggenheimer, CVP and Chief Evangelist of Microsoft Corporation.
Cloud-based technologies become more and more popular and there is a less speculation and more interest. But as the technology grows in popularity there is complexity involved. The options to choose from, the providers to select in order to put the pieces together. In the broadcast world everyone knows how complex the market is – stated the panelists – we want to make the complexity understandable. The cooperation between IC, Microsoft and HP Enterprise allow the companies to get full solution and reduce their own risk. So the customer does not need to talk to separate partners. It also to avoid confusion what works together etc. and what is not the best fit.
IC, Microsoft and HP Enterprise provide the leaders innovators solution. Microsoft is platform provider. HP is more cloud broker. Prior to NAB Imagine Communication launched 3 important applications, that required months and months of testing if the new solutions work. As Charlie Vogt mentioned IC and it’s partners goal is their customers to thrive versus not just survive. The reason is the move to the cloud, while necessary is scary, the broadcast community has been on premise for over 50 years, and the change is new.
The discussion included that cloud is a partnership – the tools, workflow, software and support all need to work together to provide the reliability and features of the current solution. As it moves to the cloud the partnership with HPE addresses the security aspects of the Azure cloud which are new to the broadcast community.
by Lidia Paulinska | May 21, 2016
April, NAB – Two years ago when we started to talk about IP and a question was – Can we do it? A year ago we were asking – Should we do it? This year a question is – How we do it? Steve Reynolds from Imagine Communications was describing the inception of AIMS, Alliance for IP Media Solutions, during our 1:1 interview. Reynolds added that in 2015 a lot of customers came to Imagine Communication with the concerns that they want to do IP but they were worried that is going to be a fragmentation in that segment of the industry. That was clearly need for AIMS.
NAB 2016 was a first year for AIMS, an industry consortium led by broadcast engineers, technologists, visionaries, vendors and business executives dedicated to an open-standards approach that moves broadcast and media companies to a virtualized, IP-based environment.
Reynolds explained that AIMS does not develop specs and standards. AIMS is trade of mind, it is marketing organization – he stated. The goal was to group the companies that primarily are working on broadcast technologies to get together and agree on the common set on the standards we want to use. The standards that are already developed. AIMS focus is on educating, evangelizing and spreading the adoption the technologies, but not to develop specs and standards. We here to help the adoption – he added. When the company joins AIMS it signs the adopter agreement, which says that they will promote this use of technologies, the AIMS roadmap, as you prefer to IP production.
More information about AIMS can be found here: http://aimsalliance.org/
