Workflow
计算机图形学
icon
Search documents
妙笔生维:线稿驱动的三维场景视频自由编辑
机器之心· 2025-08-19 02:43
Core Viewpoint - The article discusses the development of Sketch3DVE, a novel method for 3D scene video editing that allows users to manipulate videos using simple sketches, enhancing creativity and personalization in video content creation [3][22]. Part 1: Background - Recent advancements in video generation models have significantly improved text-to-video and image-to-video generation, with a focus on precise control over camera trajectories due to its important application prospects [6]. - Existing methods for video editing are categorized into two types: one directly uses camera parameters as model inputs, while the other constructs explicit 3D representations from single images to render new perspective images [8][9]. - Despite these advancements, editing real videos with significant camera motion remains a challenge, as video editing requires maintaining original motion patterns and local features while synthesizing new content [8][9]. Part 2: Algorithm Principles - Users begin by selecting the first frame of a 3D scene video, marking the editing area with a mask and drawing a sketch to specify the geometry of new objects [12]. - The system employs the MagicQuill image editing algorithm to process the first frame, generating the edited result, and utilizes the DUSt3R algorithm for 3D reconstruction to analyze the entire input video [13]. - A 3D mask propagation algorithm is designed to accurately transfer the mask from the first frame to subsequent frames, ensuring consistency across different perspectives [14]. - The final video generation model integrates edited images, multi-view videos, and original input videos to produce a scene-edited video with precise 3D consistency [14]. Part 3: Effect Demonstration - The method allows users to create high-quality 3D scene video edits, enabling operations such as adding, removing, and replacing objects while maintaining good 3D consistency [16]. - The approach can handle complex scenarios involving shadows and reflections, producing reasonable editing results due to training on real video datasets [17]. - Users can also edit the first frame using image completion methods, demonstrating the versatility of the system in generating realistic 3D scene video edits [19]. - Sketch3DVE offers an effective solution to traditional model insertion challenges, allowing for personalized 3D object generation and high-fidelity scene video editing without requiring extensive expertise [22].
奥克兰大学计算机科学本科申请:人工智能与编程的前沿突破
Sou Hu Cai Jing· 2025-05-27 04:42
Core Insights - The article emphasizes the rapid transformation of the world through artificial intelligence and programming technologies, highlighting the significance of Auckland University's computer science undergraduate program as a platform for students passionate about these fields [1]. Group 1: Program Advantages - Auckland University's computer science program boasts exceptional academic resources and a strong faculty, with the department recognized internationally for its research in artificial intelligence, data science, and cybersecurity [3]. - The faculty comprises professors from around the globe who have made significant academic contributions and maintain close collaborations with major tech companies like Google and Microsoft, integrating the latest industry trends into the curriculum [3]. - The university provides advanced learning resources, including high-performance computing clusters and virtual reality equipment, facilitating complex programming experiments and AI project development [3]. - Partnerships with numerous tech companies offer students internship and employment opportunities, allowing them to engage with real-world business projects during their studies [3]. Group 2: Application Requirements - Applicants to the computer science undergraduate program must meet specific academic and language criteria, with international students typically required to achieve an average high school score of over 80%, particularly excelling in mathematics and physics [4]. - For Chinese students, the Gaokao score is a critical reference, generally requiring a score above the provincial first-tier line; alternative qualifications like A-Level or IB scores are also accepted [4]. - Language proficiency is essential, with a minimum IELTS score of 6.5 (no individual score below 6.0) or a TOEFL score of 90 (with writing no less than 21) required for admission [4]. Group 3: Curriculum Content - The curriculum is diverse and designed to build a solid theoretical foundation and practical innovation skills, starting with introductory courses in computer science, programming basics (Python and Java), and discrete mathematics in the first year [6]. - As students progress, they encounter more specialized courses such as data structures and algorithms, computer systems principles, and database systems, deepening their understanding of computer science fundamentals [6]. - Elective courses in artificial intelligence, machine learning, computer graphics, and cybersecurity allow students to explore cutting-edge areas of interest, while project-based courses enable teamwork and problem-solving through real programming projects [6].