Documenting a few ideas that I would love to explore/experiment. These could be good academic projects or things I hope to try in my spare time. Hopefully I keep this page current. Feel free to write to me if you have more thoughts/comments.

​

​

"Data That We Can See" - A Course :

​

This idea is not about building a product or demo, but rather structuring a course around 'Data Visualization'. I would like to structure and develop a course on data visualization that can give insights about data and its various transformation.

​

A visualizer that can also prompt usual suspects like bias/variance in the data, outliers present that can introduce noise. I believe this should be the first class/lesson for someone who wants to learn data science, because if data is understood correctly it can be fit to model. This course will also cover data preprocessing and various techniques to feed data to the network like: data-generators, data-pipelines, caching and prefetching. 

​

​

​

Data Threshing :

​

We all are generating data is mind boggling speeds, facebook photos, twitter content, youtube videos, IoT devices, bla-bla ...

​

Let me give you an intuition how big the IoT data would be by end of 2019?

​

​

​

​

​

 

​

​

​

​

​

​

​

​

​

If you stack these SSD in a queue they would be 32 millions KM long. Isn't that scary and terrible thought?

We desperately need data-threshing techniques and strategies. 

​

These days most of the photos and videos are coming from High Definition cameras that means the size of the photos will be quite bulky at least more than 1 MB.

 

There are lot of photos that are duplicates, blurry, over/under exposed, out of focus, truncated, etc.  Similarly, there are quite a few strategies that we can apply for videos, like reduced FPS (Frames Per Second), remove videos that are not accessed for long time, content filtering to untag wrongly tagged videos and this will reduce the traffic on wrongly tagged video eventually deletion of the videos if it is not accessed for long time.

​

These are some raw and wild thoughts, needs lot of brainstorming and thinking.