|
|
CSE
319/419:010: Image
Analysis and Graphics |
Spring 11 |
||
|
Computer Science and Engineering Department |
||||
CSE-319/419:010: Image Analysis and Graphics
Professor Xiaolei
Huang
Instructor’s Contact Information
Office: Packard Lab 200A
Phone: (610) 758-4818
Email: xih206 AT lehigh.edu
Office hours: Thursdays 1~3pm; and by appointment (send me an email)
Course Information
CSE 319/419 Section 010
Spring 2011
TTh 10:45am - noon
Mohler Lab 355
http://www.cse.lehigh.edu/~huang/Spring11/ImageAnalysis_Graphics.html
Course Site usage: Announcements, Lecture notes, Assignments, Email lists, Discussion board
Course Description
This course introduces students to both theoretical algorithms and applications in the fields of image analysis, computer vision, and computer graphics. The materials to be discussed in the course fall into two categories: foundations and applications. First, a look at the variety of images and graphics, from pictures and videos to biomedical or satellite images, from computer generated images to animated movies, is to give students an idea about the wide application domains of imaging and graphics. Second, a set of problems that serve as foundations to most image analysis tasks will be presented and state-of-the-art algorithms addressing these problems will be discussed. Third, students will be introduced to computer graphics (CG) techniques that can be used to model object geometry, to animate, to render, and to visualize information extracted from real-world images. As a conclusion to the course, students will propose and work on a course project related to image analysis, modeling or animating a deformable (non-rigid) object. The project aims to walk the students through a whole spectrum from raw images, to extracting quantitative information or object properties from images, and finally to visualization, even synthesis by computer graphics and animation.
Course Goals
By the end of the
semester, students will be able to:
(1)
write small computer programs to perform basic image analysis,
modeling, and visualization tasks.
(2)
implement advanced algorithms for image analysis, computer graphics,
modeling and simulation.
(3)
have a basic understanding of challenging research topics in image analysis
and graphics.
(4)
propose solution to a real-world image analysis and simulation
problem utilizing knowledge learned in the class, and build an end-to-end
(interactive) computer application to tackle the problem.
Books
No Required Text
Recommended Text
Image Processing, Analysis, and Machine Vision, 3rd edition
CL-Engineering, 2007
Reference Books
Computer
Vision
Linda G.
Shapiro, George C.
Stockman
Prentice Hall, 2001
Introductory Techniques for 3-D Computer Vision
Emanuele Trucco, Alessandro Verri
Prentice Hall, 1998
OpenGL Programming Guide,
2nd Edition,
Mason Woo, Jackie Neider, Tom Davis,
Addison Wesley, 1997
Computer Graphics with OpenGL, 3rd edition,
Donald Hearn and M. Pauline Baker,
Pearson Prentice Hall, 2004
Computer Graphics using OpenGL, 3rd edition,
F.S Hill Jr, S. M. Kelley
Prentice Hall, 2007
Physically Based Modeling: Principles and Practice
http://www.cs.cmu.edu/~baraff/sigcourse/,
1997
http://www.pixar.com/companyinfo/research/pbm2001/,
2001
Articles
Related
research articles will be posted online, on Course Site, or given as handouts
in class.
Suggested Software Libraries:
Biomedical Image Analysis
o NIH Image J
http://rsb.info.nih.gov/nih-image/about.html
o NLM Insight Segmentation and Registration Toolkit
General
o Matlab from Mathworks,
http://www.mathworks.com/products/matlab/
http://www.mathworks.com/products/image/
Image Processing, Computer Vision
o Intel OpenCV library
http://www.intel.com/technology/computing/opencv/
o Others
http://www.efg2.com/Lab/Library/ImageProcessing/SoftwarePackages.htm
Computer Graphics
o OpenGL resources
http://www.cse.lehigh.edu/~huang/CSE313_Fall09/Resources.html
o The Visualization Toolkit (VTK)
o Computer Graphics related software packages available on the net
http://www.acm.org/tog/Software.html
o A C++ library implementing a Physical modeling framework described in the book “Physically-Based Modeling for Computer Graphics: A Structured Approach” by Ronen Barzel
http://sourceforge.net/projects/physics
Expectations
Your preparation, attendance,
and participation are crucial to the success of this class. You will be expected to participate in a
variety of activities including asking/answering questions related to reading
material, participating in presenting research articles, completing programming
assignments, and designing, reporting and implementing the final course
project. The end goal is for you to
understand important algorithms in biomedical image analysis, computer vision
and computer graphics, for you to be able to apply algorithms to real-world
applications, to write small- to large- scale computer programs to conduct a
research project, and to achieve the goals that motivated you to come to this
class in the first place.
Assignments
Over the course of this
semester, you will
§ participate actively in class discussions
related to assigned reading material;
§ evaluate different project options and
software options, and choose one project that you would like to work on; you
are encouraged to present your project plan in class or discuss with the
instructor out of class;
§ present 1~2 research articles related to
the project that you have chosen;
§ complete several homework assignments, two
programming projects related to fundamentals in image analysis and graphics;
§ complete the final research project, and
write a project report including the following sections: literature review,
methodology, experimental results, discussion and future work.
Your grade will be
determined as follows:
§ Homework assignments: 15%
§ Two programming assignments:
15% each, 30% total
§ Paper presentations, project
proposal and attendance: 20%
§ Final course project and project
report: 35%
Policies
Attendance Policy
Regular
attendance is required for all scheduled class meetings and students are responsible
for information covered in assigned readings, handouts, discussions and
activities. If you will miss class
because of an emergency, please notify the instructor by emailing or calling. Attendance is worth 5% of your final
grade.
Submission Policy
All projects are due at 12 midnight on the due date. Directions on how to submit projects will be announced on Course Site.
Statement on Late Papers and Missed Exams
Every assignment must be completed in order to receive a grade for the course. 10 points (out of 100) will be taken off for each day that an assignment is turned in late. In other words, 10 points will be taken off if the assignment is turned in 24 hours after the due time, and so on.
Accommodations for
Students with Disabilities
If
you have a disability for which you are or may be requesting accommodations,
please contact both your instructor and the Office of Academic Support
Services, University Center C212 (610-758-4152) as early as possible in the
semester. You must have documentation from the Academic Support Services
office before accommodations can be granted.
Academic Integrity
You have a fair amount of freedom in choosing which project to work on for this course. You can choose to work alone or work in a group. Collaboration and group projects are encouraged but must be coordinated through the instructor. For a group project, it should be made clear in the project report which student is responsible for which part of the project so that individual performance can be evaluated on top of group performance evaluation. Please refer to Lehigh’s Academic Integrity resources (http://www.lehigh.edu/~infdli/AcademicIntegrity.htm) for information about the Code of Conduct.
Schedule
Reading materials,
lecture notes, project resources will be made available on the course webpage
or on Course Site. You are responsible to check new announcements, and feel
free to use the email list and discussion board for questions.
The following schedule is tentative and is subject to
change.
|
|
Dates |
Topics |
|
|
Week 1 |
1/18, 1/20 |
Introduction,
Image Formation, Image Processing I |
· Handouts |
|
Week 2 |
1/25, 1/27 |
Image
Processing II |
· Fundamentals Image Processing · Documentation for Suggested Software Libraries |
|
Week 3 |
2/1, 2/3 |
Image
Segmentation, Active Contour Models,
Level Set based Active Contours |
· Active Contour Models
· Level Sets and Front Propagation · Region Growing Segmentation |
|
Week 4 |
2/8, 2/10 |
Intelligent
Scissors, Interactive Segmentation, |
·
Mean Shift
· Intelligent Scissors/Live Wire |
|
Week 5 |
2/15, 2/17 |
Feature Extraction |
· Features
|
|
Week 6 |
2/22, 2/24 |
Statistical Shape and
Appearance Models |
· Principal Component Analysis
· Active Shape and Appearance models |
|
Week 7 |
3/1, 3/3 |
Shape and Image Matching,
Registration |
· Shape/Image Matching and Registration
|
|
Week 8 |
3/8, 3/10 |
Spring Break |
No classes |
|
Week 9 |
3/15, 3/17 |
Motion Tracking, Object
Recognition, Detection |
·
Motion Estimation and Tracking
· Object Recognition
·
Object Detection
· AdaBoost, Support Vector Machines, Expectation-Maximization
|
|
Week 10 |
3/22, 3/24 |
Stereo, Reconstruction, Content-based Image Search
and Retrieval |
· Single-view, two-view, and multi-view reconstruction:
· Image/Graphics search and retrieval:
|
|
Week 11 |
3/29, 3/31 |
Graphics Basics |
· Transformations, Polygon Meshes, OpenGL
|
|
Week 12 |
4/5, 4/7 |
Animation, 3D Game Graphics, Rendering |
· Topics:
· Suggested Rendering Papers to present:
|
|
Week 13 |
4/12, 4/14 |
Non-rigid Deformations, Thin Plate Splines, Radial Basis Functions Course
Project Proposal Presentation |
· Thin Plate Splines
·
Radial Basis Functions Carr,
Beatson, Cherrie, Mitchell, Fright, McCallum &
Evans, “Reconstruction
and Representation of 3D Objects with Radial Basis Functions,” in ACM SIGGRAPH, 2001. |
|
Week 14 |
4/19, 4/21 |
|
· Free Form Deformations
|
|
Week 15 |
4/26, 4/28 |
Final project presentations |
|