3d literature - Revision history

Pulkit: Replaced content with "Contact Mayur or Pulkit for more information."

2013-07-13T18:33:06Z

Replaced content with "Contact Mayur or Pulkit for more information."

← Older revision		Revision as of 18:25, 13 July 2013
Line 1:		Line 1:
	~~This is a page for uploading papers and short snippets to summarize the paper and sketch out ideas. Presently, it will be used by Pulkit and~~ Mayur ~~to explore ideas for representing 3D worlds.~~		Contact Mayur or Pulkit for more information.

	~~== Sensory-motor Discussion (June 30) ==~~

	A general algorithm for transforming signals from vision to motor domain. The simple test case: Sparse coding on spatio-temporal data as a robot moves around with the world. The robot has gyros/accelerometers (referred as motion readings) attached to it. We wish to establish correlation between some of the learnt dictionary elements and the motion readings. For example a dictionary element might be a vertical bar moving from center to the periphery which would be positively correlated with forward motion. The things to investigate are:

	1. Difference in the learnt dictionary elements with and without motion cues. (One simple way of incorporating motion cues is to treat motion as an extra dimension). For example we might not get dictionary elements which directly correlate with forward/backward motion unless we put in motion cues. It will be interesting to investigate such things.

	~~2. Next, when a video is shown to the agent - it should be able to infer forward~~ or ~~backward motion. This can also be broken down into inferring/reconstructing both the image and the gyro/accelerometer information that should result in that particular spatio-temporal input.~~

	~~'''To Do''': Erick has a setup with a robot with gyro and some other motion sensors.Talk to Erick and get an update on the setup we have~~ for ~~our experiment. Further, we need to read Charle's papers on Spatial-Temporal sparse coding.~~

	~~Side note:~~

	Explore the idea of labeling surfaces in conjunction with motor data. This should naturally lead to the idea of expanding upon types of surfaces that can later be classified into objects and such. This work will differ from work in computer vision in that it will also use motor information ~~to intrinsically help label the surfaces.~~


	~~== Sensory-motor Discussion (July 4th) ==~~

	~~Learning joint representations using multi-sensory data (or motor + vision).~~

	~~Encoding with multi-sensory and testing with only vision (say). To show that learnt dictionaries are better with joint feature spaces.~~

	~~Experiment #1~~

	~~Blurry (poor visual acuity) images of different textures/surfaces. Along with data such as frictional coefficient, elasticity, etc.~~
	~~Learn two dictionaries~~
	~~a) feature space of textures~~
	~~b) feature space of textures + surface properties~~

	~~Testing: if the second dictionary wins, we are set.~~

	~~Experiment #2:~~

	~~Princeton object dataset.~~

	~~Two dictionaries:~~
	~~a) RGBD dictionary (3D)~~
	~~b) RGB dictionary (2D)~~

	~~During test time, use only RGB inputs and discard depth and see which of them buys you better classification.~~

	~~Dataset: [http://www.cs.washington.edu/rgbd-dataset/dataset.html]~~

	~~One suggestion for learning dictionary is to use a discriminative clustering algorithm~~.

Pulkit: /* Sensory-motor Discussion (July 4th) */

2013-07-10T05:19:53Z

Sensory-motor Discussion (July 4th)

← Older revision		Revision as of 05:11, 10 July 2013
Line 40:		Line 40:

	During test time, use only RGB inputs and discard depth and see which of them buys you better classification.		During test time, use only RGB inputs and discard depth and see which of them buys you better classification.

			Dataset: [http://www.cs.washington.edu/rgbd-dataset/dataset.html]

	One suggestion for learning dictionary is to use a discriminative clustering algorithm.		One suggestion for learning dictionary is to use a discriminative clustering algorithm.

Mudigonda at 21:49, 4 July 2013

2013-07-04T21:49:48Z

← Older revision		Revision as of 21:41, 4 July 2013
Line 14:		Line 14:

	Explore the idea of labeling surfaces in conjunction with motor data. This should naturally lead to the idea of expanding upon types of surfaces that can later be classified into objects and such. This work will differ from work in computer vision in that it will also use motor information to intrinsically help label the surfaces.		Explore the idea of labeling surfaces in conjunction with motor data. This should naturally lead to the idea of expanding upon types of surfaces that can later be classified into objects and such. This work will differ from work in computer vision in that it will also use motor information to intrinsically help label the surfaces.


			== Sensory-motor Discussion (July 4th) ==

			Learning joint representations using multi-sensory data (or motor + vision).

			Encoding with multi-sensory and testing with only vision (say). To show that learnt dictionaries are better with joint feature spaces.

			Experiment #1

			Blurry (poor visual acuity) images of different textures/surfaces. Along with data such as frictional coefficient, elasticity, etc.
			Learn two dictionaries
			a) feature space of textures
			b) feature space of textures + surface properties

			Testing: if the second dictionary wins, we are set.

			Experiment #2:

			Princeton object dataset.

			Two dictionaries:
			a) RGBD dictionary (3D)
			b) RGB dictionary (2D)

			During test time, use only RGB inputs and discard depth and see which of them buys you better classification.

			One suggestion for learning dictionary is to use a discriminative clustering algorithm.

Mudigonda: /* Sensory-motor Discussion (June 30) */

2013-07-01T07:46:27Z

Sensory-motor Discussion (June 30)

← Older revision		Revision as of 07:38, 1 July 2013
Line 7:		Line 7:
	1. Difference in the learnt dictionary elements with and without motion cues. (One simple way of incorporating motion cues is to treat motion as an extra dimension). For example we might not get dictionary elements which directly correlate with forward/backward motion unless we put in motion cues. It will be interesting to investigate such things.		1. Difference in the learnt dictionary elements with and without motion cues. (One simple way of incorporating motion cues is to treat motion as an extra dimension). For example we might not get dictionary elements which directly correlate with forward/backward motion unless we put in motion cues. It will be interesting to investigate such things.

	2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion.		2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion. This can also be broken down into inferring/reconstructing both the image and the gyro/accelerometer information that should result in that particular spatio-temporal input.

	'''To Do''': Erick has a setup with a robot with gyro and some other motion sensors.Talk to Erick and get an update on the setup we have for our experiment. Further, we need to read Charle's papers on Spatial-Temporal sparse coding.		'''To Do''': Erick has a setup with a robot with gyro and some other motion sensors.Talk to Erick and get an update on the setup we have for our experiment. Further, we need to read Charle's papers on Spatial-Temporal sparse coding.

			Side note:

			Explore the idea of labeling surfaces in conjunction with motor data. This should naturally lead to the idea of expanding upon types of surfaces that can later be classified into objects and such. This work will differ from work in computer vision in that it will also use motor information to intrinsically help label the surfaces.

Pulkit at 06:50, 1 July 2013

2013-07-01T06:50:40Z

← Older revision		Revision as of 06:42, 1 July 2013
Line 9:		Line 9:
	2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion.		2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion.

	'''To Do''': Erick has a setup with a robot with gyro and some other motion sensors. ~~Mayur will talk~~ to Erick and ~~provide~~ an update on the setup we have for our experiment. Further, we need to read Charle's papers on Spatial-Temporal sparse coding.		'''To Do''': Erick has a setup with a robot with gyro and some other motion sensors.Talk to Erick and get an update on the setup we have for our experiment. Further, we need to read Charle's papers on Spatial-Temporal sparse coding.

Pulkit at 06:40, 1 July 2013

2013-07-01T06:40:58Z

← Older revision		Revision as of 06:32, 1 July 2013
Line 9:		Line 9:
	2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion.		2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion.

	'''To Do''' Erick has a setup with a robot with gyro and some other motion sensors. Mayur will talk to Erick and provide an update on the setup we have for our experiment. Further, we need to read Charle's papers on Spatial-Temporal sparse coding.		'''To Do''': Erick has a setup with a robot with gyro and some other motion sensors. Mayur will talk to Erick and provide an update on the setup we have for our experiment. Further, we need to read Charle's papers on Spatial-Temporal sparse coding.

Pulkit at 06:40, 1 July 2013

2013-07-01T06:40:42Z

← Older revision		Revision as of 06:32, 1 July 2013
Line 8:		Line 8:

	2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion.		2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion.

			'''To Do''' Erick has a setup with a robot with gyro and some other motion sensors. Mayur will talk to Erick and provide an update on the setup we have for our experiment. Further, we need to read Charle's papers on Spatial-Temporal sparse coding.

Pulkit at 06:36, 1 July 2013

2013-07-01T06:36:43Z

← Older revision		Revision as of 06:28, 1 July 2013
Line 1:		Line 1:
	This is a page for uploading papers and short snippets to summarize the paper and sketch out ideas. Presently, it will be used by Pulkit and Mayur to explore ideas for representing 3D worlds.		This is a page for uploading papers and short snippets to summarize the paper and sketch out ideas. Presently, it will be used by Pulkit and Mayur to explore ideas for representing 3D worlds.

	Discussion on June 30		== Sensory-motor Discussion (June 30) ==

	A general algorithm for transforming signals from vision to motor domain. The simple test case: Sparse coding on spatio-temporal data as a robot moves around with the world. The robot has gyros/accelerometers (referred as motion readings) attached to it. We wish to establish correlation between some of the learnt dictionary elements and the motion readings. For example a dictionary element might be a vertical bar moving from center to the periphery which would be positively correlated with forward motion. The things to investigate are:		A general algorithm for transforming signals from vision to motor domain. The simple test case: Sparse coding on spatio-temporal data as a robot moves around with the world. The robot has gyros/accelerometers (referred as motion readings) attached to it. We wish to establish correlation between some of the learnt dictionary elements and the motion readings. For example a dictionary element might be a vertical bar moving from center to the periphery which would be positively correlated with forward motion. The things to investigate are:

	1. Difference in the learnt dictionary elements with and without motion cues. (One simple way of incorporating motion cues is to treat motion as an extra dimension). For example we might not get dictionary elements which directly correlate with forward/backward motion unless we put in motion cues. It will be interesting to investigate such things.		1. Difference in the learnt dictionary elements with and without motion cues. (One simple way of incorporating motion cues is to treat motion as an extra dimension). For example we might not get dictionary elements which directly correlate with forward/backward motion unless we put in motion cues. It will be interesting to investigate such things.

	2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion.		2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion.

Pulkit at 06:35, 1 July 2013

2013-07-01T06:35:17Z

← Older revision		Revision as of 06:27, 1 July 2013
Line 1:		Line 1:
	This is a page for uploading ~~papes~~ and short snippets to summarize the paper and sketch out ideas. Presently, it will be used by Pulkit and Mayur to explore ideas for representing 3D worlds.		This is a page for uploading papers and short snippets to summarize the paper and sketch out ideas. Presently, it will be used by Pulkit and Mayur to explore ideas for representing 3D worlds.

			Discussion on June 30
			A general algorithm for transforming signals from vision to motor domain. The simple test case: Sparse coding on spatio-temporal data as a robot moves around with the world. The robot has gyros/accelerometers (referred as motion readings) attached to it. We wish to establish correlation between some of the learnt dictionary elements and the motion readings. For example a dictionary element might be a vertical bar moving from center to the periphery which would be positively correlated with forward motion. The things to investigate are:
			1. Difference in the learnt dictionary elements with and without motion cues. (One simple way of incorporating motion cues is to treat motion as an extra dimension). For example we might not get dictionary elements which directly correlate with forward/backward motion unless we put in motion cues. It will be interesting to investigate such things.
			2. Next, when a video is shown to the agent - it should be able to infer forward or backward motion.

Mudigonda: Created page with "This is a page for uploading papes and short snippets to summarize the paper and sketch out ideas. Presently, it will be used by Pulkit and Mayur to explore ideas for representin..."

2013-06-28T18:39:16Z

Created page with "This is a page for uploading papes and short snippets to summarize the paper and sketch out ideas. Presently, it will be used by Pulkit and Mayur to explore ideas for representin..."

New page

This is a page for uploading papes and short snippets to summarize the paper and sketch out ideas. Presently, it will be used by Pulkit and Mayur to explore ideas for representing 3D worlds.