Realtimes Shanghai Travel | Workshop on Innovative Application of Generative AI and Large Models in edge

On December 28,2023； a conference was held in Shanghai on the application and solution of generative AI and big models in the edge computing field of the Jetson Orin platform. This conference gathered industry elites to discuss the latest development and application prospects of generative AI and large models in the field of edge computing.

On the agenda of the meeting, Wang Guangming, founder of Realtimes, introduced six scenarios and application cases, and explained the application scenarios and potential of generative AI in the field of edge computing in simple terms. He pointed out that with the development of technology, generative AI and large models will be applied in more fields, bringing more efficient and intelligent solutions to humanity. NVIDIA accelerates the rapid implementation of generative AI.

NVIDIA accelerated generative AI landing fast

Li Ming, Director of Developer Relations for NVIDIA Asia Pacific, delivered a speech titled "NVIDIA Accelerates the Rapid Landing of Generative AI and Opens the Golden Decade of AI 2.0". He detailed the latest progress and technological innovations of NVIDIA in the field of generative AI, and looked forward to the future development trend in the era of AI 2.0. He said that NVIDIA would continue to work hard to promote the rapid development of generative AI and make greater contributions to the era of AI 2.0.

Metropolis on Jetson's acceleration of large-scale model marginalization intelligent applications is also one of the important topics of the conference. Lei Hao, NVIDIA developer relations manager, discussed how to use the Jetson Orin edge computing platform to accelerate the deployment and application of large models. He stated that the Jetson Orin platform has high-performance and low-power characteristics, suitable for various application scenarios that require real-time data processing, and will provide strong support for the deployment and application of large models.

TensorRT-LLM on Jetson Orin

Gai Qingqing, a senior deep learning engineer at NVIDIA, introduced in detail the advantages and functions of TensorRT in large model deployment, and shared how to accelerate the private deployment of large models on the Jetson Orin platform using TensorRT. She said that TensorRT would provide more efficient and reliable assistance for the deployment and application of large models.

Qin Yu, the technology manager of Realtimes, gave a speech on "Introduction to Common Large Models and NVIDIA's Private Large Model Solution for Edge Deployment". He gave an in-depth introduction to common types and characteristics of large models, and shared the solutions and practical cases of Realtimes in deploying private large models at the edge; The product level solutions provided by Realtimes attracted the attention of a large number of participants. The site also provided edge computing devices that directly run the large model on the edge. Participants began to experience it, and intuitively felt the friendly interaction and efficient performance of the generated AI big model on the edge.

In addition, Yan Kai, Director of Shanghai Fuya Intelligent Products, delivered a keynote speech on "Automatic Flight Application of UAV Based on edge computing". He introduced in detail how to use edge computing technology to realize automatic flight of UAVs, as well as the prospects and opportunities in the application field of UAVs. He stated that with the development of technology, drones will be applied in more fields, bringing more efficient and intelligent solutions to humanity.

The successful holding of this conference has provided strong support for promoting the application and development of generative AI and large models in the field of edge computing. Participants said that through this meeting, they have deepened their understanding of the application of generative AI and large models in the field of edge computing, and gained valuable experience and technical enlightenment.

With the continuous development of science and technology, the application prospect of generative AI and large models in the field of edge computing will be broader. We believe that in the near future, these advanced technologies will bring more surprises and changes to mankind.

At the same time, this event also opened up online live streaming, allowing partners who could not attend the event to learn about and study the content of the seminar in real time.

With the continuous development of science and technology, the application prospect of generative AI and large models in the field of edge computing will be even broader. We believe that in the near future, these advanced technologies will bring more surprises and changes to humanity.