AMIPS:The Anywhere, Multipurpose Image

Projection System

Nicholas LordBudirijanto PurnomoPaul Alan Roberts  

Johns Hopkins UniversityDepartment of Computer ScienceCISST Division

                                                      

What’s Been DoneFebruary

• Obtained access to CIRL Lab and ERC• Installed necessary environment for

XVision, Matlab, and Mathematica• Performed Camera Calibration with Matlab

March 1st-15th

• Used XVision to manipulate raw images obtained from live video camera

• Wrote simple program that can capture images via firewire camera and manipulate

• Built a prototype of AMIPS display board• Experimentation of color segmentation with

XVision

March 15-Present Day

• Project split

• 3D Pose estimation (Paul)

• Smarter presentation implementation (Nick)

• Correcting Distortions using Graphics Hardware (Budi)

3D Pose

• It is necessary to calculate the 3d position to calculate the prewarp map for the hardware rendering.

• Currently the equation solutions are handled with mathematica programming

• U1 = X1*f/Z1, U2=x2*f/Z2… up to U4

• V1= Y1/*f/Z1…up to V4

• Thus we have 8 equations and 12 unknowns

• Constrain system by incorporation of the known size of the board

• L = sqrt( [x1-x2]^2 + [Y1-Y2]^2 + [Z1-Z2]^2)

Progress 3D Pose

• Early theory success

• Structure of algorithm

• 12 nonlinear simultaneous equations that constrain the position.

• Mathematica solver

• Condition: 8/10

Correcting Distortions caused by Oblique Projection using

Graphics Hardware• Basic goal:

• Take an image and texture map the distorted image onto the image thereby removing the artifacts and distortions

Progress Graphics Hardware

• Algorithm nearly completed: – We have a working model which dewarps the

image

• Possible problems:

• Condition 9/10

Smarter Presentation

• If the projection screen is flat, it is possible to directly establish the relationship between the camera and projector through comparing camera images and projector slides

Pictorial Representation

Progress Smarter Presentation

• Current position: Prewarp mapping calculated

• Work to complete:– Debugging – Blend Algorithm

• Condition: 6/10

What’s next?

• Stringing these methods together

• Testing Implementation.

• Solving the broad projection problem

Solution

• Find part of image that needs to be projected

• Project only that small part onto the board

Dependencies

• Continued use of computer labs and funding.

• IBM dependency totally removed.

• Continued use of projector and camera for project

Final Words

• We are in a very pivotal position at the current time.

• One major goal to accomplish– Three goals to wrap up