Automatic spelling correction
Continuing with our NLP saga, I am uploading a very interesting article from Silviu Cucerzan and Eric Brill titled "Spelling correction as an iterative process that exploits the collective knowledge of web users". It gives some very good insights into how automatic spelling correction and how non-trivial the task is. As a side note, Norvig's post on spelling correction is also worth reading.
Posted by abarrera 2007-09-13 11:52:18
Short term memory realistic model
After summer we come back with some interesting articles. I have just uploaded an article of a current model of short term memory by Roudi and Latham from Gatsby Computational Neuroscience Unit at UCL. The article answers two important unanswered questions: how does a neural network exhibits irregular firings? and how many memories can be stored in the network under realistic biological conditions?. Really interesting article, although pretty mathematical. "
Posted by abarrera 2007-09-13 11:43:47
Cocktail Party Problem
Here comes another paper linked to Dr. Robert Hecht-Nielsen about the Cocktail Party Problem. With the advent of new Natural Language Processing systems, and smart AI technologies, it is a matter of time until you face the Cocktail Party Problem. It is basically the ability to focus on one listeners stream among a group of simultaneous conversations. It is been a widely known problem and has been tackled in many ways. Nevertheless, the model presented here is based on biological data and proves to be very robust in real world scenarios. What I like more about the model is the use of predictions (expectations) of what words come next while listening to someone. If you think about it, humans don't grasp every single word in a conversation in a noisy environment. We normally fill in the gaps with expectations. This is the same mechanism proposed in this model. Worth reading!
Posted by abarrera 2007-07-23 11:49:15
Perceptron monograph
The Perceptron is a type of Artificial Neural Network invented in 1957 by Rosenblatt. It is the most well known ANN algorithm since the creation of the field. Nevertheless, it's hard to find good papers (and free) about it (except the original ones). I must thank Robert Hecht-Nielsen for posting this wonderful monograph about it, I find kind of amusing the appendix where he talks about the history of the Perceptron and a fact which I didn't know, that was that Rosenblatt used Minsky's hardware schemes for his Perceptron machine. This could have been, as pointed by Dr. Hectt-Nielsen, one of the reasons behind the attacks to the Perceptron by Minsky. Read more in the monograph.
Posted by abarrera 2007-07-23 11:34:09
Lucke's articles on minicolumns dynamics
First of all, sorry if someone has experienced problems with the atom feed during the weekend. I had some troubles with an upgrade. Now it should work without a glitch. After posting my master thesis I have decided to upload the articles from Jorg Lucke in which it's based. While thinking about the thesis I came through Lucke's works and I was very shocked to find that he had been working on minicolumn dynamics for quite some time. I really recommend his papers for anyone interested in minicolumn/macrocolumn neural network dynamics. Some of the papers are also coauthored by Von der Malsburg but I really recommend all of them, as they give a really good insight in to how to model inhibition between populations of minicolumns."
Posted by abarrera 2007-06-18 10:23:10
Finished my MS in Computer Science
Finally I have completed my MS in Computer Science. Today I presented my Master thesis (N-HANNA: Neocortical Artificial Neural Network Architecture) and had a grade of A+. I have just uploaded both, the Master thesis and the slides of the presentation. Both of them are in Spanish. If someone is really interested in a translation, please let me know and we can work something out. Enjoy!"
Posted by abarrera 2007-06-18 09:44:46
RSS Feed and updated personal information
I have finally finished the RSS Feed (atom) support for neurosecurity. It should be working ok, but let me know if you experience any glitches. Now you can follow neurosecurity's updates by syndicating to the news feed. I have also uploaded my CV (English and Spanish versions) to the section about me. I have also uploaded my LinkedIn public profile url in the same section. Enjoy the new RSS Feed.
Posted by abarrera 2007-06-05 20:08:27
Cognitive Computing 2007 online presentations
Some weeks ago, UC Berkeley uploaded the presentations from the Cognitive Computing symposium (you can find the web page here). I had the chance to look at several of the presentations. From the ones I saw, I recommend the one from Paul Rhodes (Evolved Machines Inc.) about the next generation fpga simulators. For my taste, it's one of the best presentations, in terms of clearness and organization, that I've seen. His works seem very related to the ones done by Dr. Kwabena Boahen in Stanford. I also recommend Jose Carmena's works with BMI's and some cool videos he shows. Finally I specially recommend Robert Hecht-Nielsen's presentation. He talks about speech processing and shows some really incredible demonstrations of his team's work. I talked about his theories some posts ago and how he had envisioned what he calls the Confabulation Theory.
Posted by abarrera 2007-06-05 16:10:54
Cognitive Computing 2007
After the last cognitive computing conference in IBM's Almaden Research Institute, it seems the people want more. That is why this year the cognitive computing conference is hosted by UC Berkeley, Citris and Nersc at the Auditorium of the Berkeley Art Museum during the 2nd and 3rd of May. Some interesting speakers like Robert Hecht-Nielsen or Dileep George, among others. Lets hope they will upload videos from the speeches.
Posted by abarrera 2007-05-01 14:14:10
Rapid categorization with visual cortex approach
Tomaso A. Poggio and his team at MIT, make it back with new data from their new cortical model of visual detection. Based on biological data, it is very probable that primates employ some kind of feedforward process for rapid categorization of objects on the visual cortex. Serre et al. explain their novel model in a new paper called: A feedforward architecture accounts for rapid categorization. This article reminds me of Jeff Hawkin's explanation of the neocortex and the invariant problem. It illustrates the hierarchical pathway of information in the visual system and how it works. This, as the authors say, doe
Posted by abarrera 2007-04-25 14:13:35
Genetic Evolution of Communication in robots
I have read recently an interesting article from Laurent Keller et al. of the University of Lausanne. The title is Evolutionary Conditions for the Emergence of Communication in Robots and it talks about the evolution of communication systems in robots. Each robot has an internal neural controller, which is trained and evolved with genetic algorithms, which tells the robot how to move around its world. This neural controller also controls a red/blue led the robots have. The amazing results are that after several generations the robots where able to develop a communication system using their leds so they could signal their mates. The neural network of each
Posted by abarrera 2007-04-24 14:13:11
New cognitive linguistic section
Since my time at UC Berkeley I have been thinking about cognitive linguistic and possible computational models. That is why I am opening a new articles section so I can upload some interesting papers about that field. Currently I have uploaded the Ph.D Thesis of Srinivas Sankara Narayanan, former researcher at SRI. The title is: Knowledge-based Action Representations for Metaphor and Aspect (KARMA) where he goes into detail of a neural system that is able to create metaphors. I have also uploaded a recent paper from Jaime Carbonell et al. titled Context-Based Machine Translation which describes a novel method for machine translations. It's really impressive stuff and I'm currently working with some ideas from that paper.
Posted by abarrera 2007-03-22 14:20:11
Some online presentations
The University of California, Berkeley organized last January a conference on Brain Network Dynamics to honor Professor Walter Freeman for his contributions to brain dynamics over the past five decades, on the occasion of his 80th birthday. Hopefully, some presentations have been uploaded for our delight and can be found here.
Posted by abarrera 2007-03-22 14:12:19
New articles
First of all, sorry for the delay. I normally take some time before updating this web, but this time it took too much. I've uploaded two interesting papers. One of them is called Robust Object Recognition with Cortex-Like Mechanisms and introduces some interesting ideas for hierarchical neural models. The other paper is a study on Dynamic Recurrent Neural Networks explaining the basics of these networks. Pretty handy for a quick introduction on the subject.
Posted by abarrera 2007-03-21 14:26:24
Numenta software and demo release
Our guys at Numenta have finally released their Numenta Platform for Intelligent Computing (NuPIC). You can watch a demo (Windows version only) here: demo. You can download the first version of the framework here (you need to create an account first): Download. I recommend a good read at the license terms, as it's important to remember that you can't use this software for commercial purposes or sell any information obtained with it. I'll play with it the next days and I'll post my conclusions.
Posted by abarrera 2007-03-21 14:11:49
Bioengineering, the future of neural models?
I have been thinking for some time that one of the mistakes in the neurocomputational field is that we are trying to simulate models with tools that weren't meant for it. Most of the computations require extreme parallel architectures which aren't very common. That's where people like Dr. Kwabena Boahen working for. Dr. Boahen leads the Brains in Silicon lab in Stanford University. It's amazing what they're currently developing and I'm sure it is going to be the future of neurocomputations. I have inaugurated a new section in the articles page dealing with Bioengineering articles like the ones from Dr. Boahen's lab. Feel free to send me more information on the subject. There is also an impressive conference of Dr. Boahen explaining their work (Sorry it's only in Realmedia format). I highly recommend everyone interested to first watch the movie and then read the articles. More videos of other conferences at the Multi-level Brain Modeling Workshop site.
Posted by abarrera 2007-01-04 14:28:18
Confabulatory Theory
While poking around the RNI seminar's webpage I found about the Confabulatory Theory. Although I do feel it's a little bit "ad-hoc" it does expose some interesting ideas worth thinking about. You'll find the video conference at this link and the synopsis here.
Posted by abarrera 2007-01-04 14:10:54
Old classical papers
First of all, happy New Year to everyone!! Finally I've uploaded several classical papers on neuroscience. The first one is the complete series of Hodgkin and Huxley articles on the action potential models of the squid's axon. The other now classical but very interesting paper is the one written by Elman about recurrent networks and Finding Structure in Time. Both articles can be found at the articles section.
Posted by abarrera 2007-01-03 14:30:02
Articles on mathematical Neuroscience
Last week I came across several papers about mathematical Neuroscience. The first one is a series of Lectures given by Paul Bressloff at the PCMI on Mathematical Neuroscience. He deals with quite some topics like spiking neural models, chemical synapses, firing rates, neural code, neural pattern formation or spike time-dependant plasticity (STDP). All topics are focus on the mathematical equations that drive the computational models. The second paper is just a little introduction by Viktor Jirsa to Complex Systems Tools, mathematical principles that support the neurocomputing field. It's recommended for Undergrads or people who want to learn a quick introduction to these math
Posted by abarrera 2006-11-24 14:07:03
Some new interesting links
I have just updated the links section with three pretty interesting links. The first two are a collection of psychology and neuroscience cl assic papers. You can even find the Hodgkin and Huxley original papers. The third link is UCSD video archive about neuroscience. If you know some other cool resources, just let me know.
Posted by abarrera 2006-10-10 14:06:35
Categorizing and Learning Module (CALM)
CALM is a quite neat idea for an Artificial Neural Network design. It was designed sometime ago but introduced some neurobiological ideas which even today aren't being extensible use. It's grounded on a multi-modular hierarchical architecture, employs both supervised and unsupervised learning, it develops self-organization, can process sequential information and presents the idea of autonomous addition and pruning of nodes. I must thank Adriaan Tijsseling for granting permission to reproduce his nice overview of CALM. He also provides a basic CALM Api un C++ which you can find on his website: http://www.kung-foo.tv/calmapi.html.
Posted by abarrera 2006-09-19 16:09:53
UC Berkeley, Jerry Feldman and the Neural Theory of Language (NTL)
Finally I am back from UC Berkeley. I have been there for two months taking some classes and I must confess I have had an incredible time. During one of my classes I had the pleasure of having a lecture from Jerry Feldman. I have uploaded the presentation on NTL he gave us which has some interesting models and examples. There is also a podcast where he introduces his new book which I believe introduces the reader into what the NTL Project is.
Posted by abarrera 2006-09-06 14:05:00
Almaden Institute 2006 presentations and video feed available
As some of you might now, this year, the Almaden Research Center if IBM organized a congress on Cognitive Computing. They've made nearly all presentations available. You can download all the video feeds for all presentation. I recommend the one from Jeff Hawkins, specially the Questions and Answers part. The presentations and video feeds can be reached here.
Posted by abarrera 2006-07-15 14:04:31
Numenta's Hierarchical Temporal Memory
Numenta has just released a whitepaper on their Hierarchical Temporal Memory (HTM). It's a very interesting paper where they explain the basic concepts behind their cognitive model. It's a recommended lecture for those that have read about Jeff Hawkin's Memory Prediction Framework (MPF) or are interested in advanced AI computational models.
Posted by abarrera 2006-05-17 14:03:35
Creating Neural Networks with genetic algorithms
I have added two very interesting articles to the collection. They are both about the use of genetic algorithms in generating and adapting neural networks. I must thank Daniel Manrique from the Artificial Intelligence Department of the Computer Science School of the UPM for granting me permission to upload his works on this field. The second article defines an Evolutionary System that defines and trains an artificial neural network (RBF).
Posted by abarrera 2006-04-19 13:59:37
Neocortical microstructure comparison
I want to thank Javier de Felipe from the Cajal Institute (CSIC) for granting me permission to upload one of his works. It's a really interesting article about neocortical microstructure comparisons between mammal brains. It gives many insights to the subtle, but important differences, between the human brain and other mammal's brains. I want to thank him also for sending me a very interesting article about Ramon y Cajal's drawings and life overview. (Sorry it's in spanish).
Posted by abarrera 2006-04-16 13:53:21
About neurocortical columns
I have just uploaded a must read
article from Vernon Mountcastle
called The columnar organization of the neocortex.
It describes in great detail many fundamental things about cortical minicolumns. Anybody
interested on cortical columns should read this article as we shall remember that
V. Mountcastle is probably one of the fathers of cortical minicolumns.
Posted by abarrera 2006-01-23 13:52:41
New whitepaper published
Finally I have uploaded a whitepaper I finished some months ago. It is about the present and future of Intrusion Detection Systems (IDS). It describes the current problems of IDS and possible solutions to them. The whitepaper is only available in spanish but I will translate it pretty soon. Thanks to those that took the time to review the paper and submit errors. Merry Christmas to all and happy new year!
Posted by abarrera 2005-12-31 13:52:15
New links section
At last I have added some links about neuroscience and neurocomputing. I have included some mayor Artificial Neural Networks events around the globe and some interesting research centers and companies. If you want your link to be added to the list, just tell me about it.
Posted by abarrera 2005-12-21 13:51:38
Redwood Center Inaugural Symposium (2005)
As some may know, Redwood Neuroscience Institute (RNI) has merged into UC Berkeley and has been renamed to Redwood Center for Theoretical Neuroscience. They have videotaped the inaugural symposium and it is available for download. It has pretty good video and although the audio comes and goes sometimes, it is worth it. Some key speeches from Bruno Olshausen, Redwood Center's Director, Horace Barlow, Cambridge University or Jeff Hawkins talking about his new enterprise, Numenta are worth the 4,4Gb download.
Posted by abarrera 2005-12-15 13:49:52
Final project
I am beginning my final project at my university. I will be publishing a little article on IDS and neural networks pretty soon (I hope). I have uploaded an interesting article about IDS evasion and a new bibliographical entry: Neural Networks: A comprehensive foundation by Simon Haykin. It is one of the best books I have ever read. It doesn't talks about spiking neural models but it is a great compendium of neural networks models and algorithms. It is a "must have" for anybody truly interested in neural networks.
Posted by abarrera 2005-10-01 13:49:26
New information security articles
Finally I am beginning to group some interesting articles on information security. Most of them are related with Intrusion Detection Systems (IDS) or similar (HIDS, IPS, etc.). Special attention to the article dealing with keystroke eavesdropping using neural networks.
Posted by abarrera 2005-09-14 13:48:56
Interesting article and more stuff
I have uploaded two more articles. One of them is of special interest for those who know about Jeff Hawkins's MPF. The article is a little introduction from Vernon Mountcastle to the world of cortical columns. Although very short, it is worth reading. Also, a new bibliographic section is available from now on.
Posted by abarrera 2005-09-01 13:48:16
Some articles
I have uploaded some articles I feel are
pretty good about Neuroscience.
Some of them deal with neocortical algorithms and others about Spiking Neural Networks
.
I still have to set some more and eventually I will be upgrading this section on a regular
basis. If someone feels I should add one specific paper just mail me and I will check it.
Posted by abarrera 2005-08-31 13:47:47
Welcome to Neurosecurity.com
Neurosecurity's objective is to become the meeting point for all those
whom-s main interests are the Neurocomputing
and Cognitive Science
fields.
This page will host all kind of papers related with the aforementioned subjects, as for
all kind of related computing projects such as, Artificial Neural Networks
or any other
type of project which involves connectionist AI applied
to the Information Security
fields.
Posted by abarrera 2005-08-25 13:46:48
