Showing posts with label data mining. Show all posts
Showing posts with label data mining. Show all posts

Tuesday, March 20, 2012

[252] Vintage Comics - Son of God

Estoy emocionalmente drenado.  Tuve que ir a una reunion con la ex y no fue nada agradable.  Asi que decidi poner de mi lista de backlinks la siguiente historia.  El Comic Son O' God se publicaba en la revista National Lampoon alla para el 1974.  Es tan blasfemo que merece presentarse en su totalidad, links debajo...


http://www.dialbforblog.com/archives/417/index.html

http://www.dialbforblog.com/archives/417/sonogod2.html

http://www.dialbforblog.com/archives/417/sonogod3.html

En otros temas queria mencionar  este articulo que habia salido en wired.  Trataba de como Target usaba algoritmos y data minada de los recibos para poder predecir patrones de compra de sus clientes.  En este caso partiucular enviar promociones prenatales a mfuturas madres basadas en sus compras en meses previos.  Creepy en mi opinion, pero es el uso de la estadistica y conocer nuestros patrones de compras...

http://vigilantcitizen.com/latestnews/how-companies-learn-your-secrets/

How Companies Learn Your Secrets

Andrew Pole had just started working as a statistician for Target in 2002, when two colleagues from the marketing department stopped by his desk to ask an odd question: “If we wanted to figure out if a customer is pregnant, even if she didn’t want us to know, can you do that? ”
Pole has a master’s degree in statistics and another in economics, and has been obsessed with the intersection of data and human behavior most of his life. His parents were teachers in North Dakota, and while other kids were going to 4-H, Pole was doing algebra and writing computer programs. “The stereotype of a math nerd is true,” he told me when I spoke with him last year. “I kind of like going out and evangelizing analytics.”
As the marketers explained to Pole – and as Pole later explained to me, back when we were still speaking and before Target told him to stop – new parents are a retailer’s holy grail. Most shoppers don’t buy everything they need at one store. Instead, they buy groceries at the grocery store and toys at the toy store, and they visit Target only when they need certain items they associate with Target – cleaning supplies, say, or new socks or a six-month supply of toilet paper. But Target sells everything from milk to stuffed animals to lawn furniture to electronics, so one of the company’s primary goals is convincing customers that the only store they need is Target. But it’s a tough message to get across, even with the most ingenious ad campaigns, because once consumers’ shopping habits are ingrained, it’s incredibly difficult to change them.
There are, however, some brief periods in a person’s life when old routines fall apart and buying habits are suddenly in flux. One of those moments – the moment, really – is right around the birth of a child, when parents are exhausted and overwhelmed and their shopping patterns and brand loyalties are up for grabs. But as Target’s marketers explained to Pole, timing is everything. Because birth records are usually public, the moment a couple have a new baby, they are almost instantaneously barraged with offers and incentives and advertisements from all sorts of companies. Which means that the key is to reach them earlier, before any other retailers know a baby is on the way. Specifically, the marketers said they wanted to send specially designed ads to women in their second trimester, which is when most expectant mothers begin buying all sorts of new things, like prenatal vitamins and maternity clothing. “Can you give us a list?” the marketers asked.

Estamos llegando a los dias de They Live, donde los extraterrestres nos controlan con mensajes submiminales???
http://en.wikipedia.org/wiki/They_Live

Monday, October 17, 2011

[204] Open Bible - Visualizando Positivismo y Negativismo en los Libros


Tropece con esta interesante visualizacion de la Biblia.  Denota acciones positivas en Rojo y acciones negativas en Negro.  Como siempre decimos, el demonio esta en los detalles.  No sabemos todos los detalles de su metodologia pero lleva su punto de que el Libro puede ser interpretado positivamente o negativamente.

La organizacion que fundamenta este tipo de analisis es de una pagina llamada openbible.  La intencion, simplificar y crear distribuciones de informacion para hacer analisis electronicos y estadisticos a la Biblia y sus diferentes versiones.  El movimiento open se ha hecho para tratar de hacer una reglamentacion mas organizada para los sistemas de recoleccion de data modernos.

Primero les dejo el link original:

Sentiment analysis involves algorithmically determining if a piece of text is positive (“I like cheese”) or negative (“I hate cheese”). Think of it as Kurt Vonnegut’s story shapes backed by quantitative data.
I ran the Viralheat Sentiment API over several Bible translations to produce a composite sentiment average for each verse. Strictly speaking, the Viralheat API only returns a probability that the given text is positive or negative, not the intensity of the sentiment. For this purpose, however, probability works as a decent proxy for intensity.
The visualization takes a moving average of the data to provide a coherent story; the raw data is more jittery.

Crean o no en la metodologia lo importante es la mecanizacion de los procesos.  Estudie en mas detalles articulos previos de la pagina.  Es interesante que los problemas en digitalizar y procesar la informacion son similares a los de cualquier base de datos con programacion SQL, etc.  Aqui les dejo un poco de info de la organizacion:


Este paper busca como minar datos de redes sociales como Twitter y Facebook para buscar las citas y referencias mas usadas.  Miren el analisis:

The data consists of about 35 million total references.
Percent of TotalDescriptionExample
73.5Single verseJohn 3:16
17.1Verse range in a single chapterJohn 3:16-17
8.4Exactly one chapterJohn 3
0.7Two or more chapters (at chapter boundaries)John 3-4
0.1Verses spanning two chapters (not at chapter boundaries)John 3:16-4:2
0.1Verses spanning three or more chapters (not at chapter boundaries)John 3:16-5:2
About 92.9% of posts or tweets cited only one verse or verse range; 7.1% mentioned more than one verse range. Of the latter, 77% cited exactly two verse ranges; the highest had 323 independent verse ranges. Of Facebook posts, 9.1% contained multiple verse ranges, compared to 4.2% of tweets. When there were multiple ranges, 43% of the time they referred to verses in different books from the other ranges; 39% referred to verses in the same book (but not in the same chapter); and 18% referred to verses in the same chapter. (This distribution is a unusual—normally close verses stick together.)
The data, oddly, doesn’t contain any references that span multiple books. Less than 0.01% of passage accesses span multiple books on Bible Gateway, which is probably a useful upper bound for this type of data.

Key Points

  1. Nearly all citations involve verses in the same chapter; only 1% involve verses in multiple chapters.
  2. Of the 1% spanning two or more chapters, most refer to exact chapter boundaries.
  3. Multiple-book references are even more unusual (under 0.01%) but have outsize effects: an annotation that references Genesis 1 to Revelation 22 would be relevant for every verse in the Bible.
  4. Around 7% of notes contained multiple independent ranges of verses—the more text you allow for an annotation, the more likely someone is to mention multiple verses.
Estuvo fascinante la metodologia de cambiar el metodo de referenciar los libros del sistema de capitulos y versiculos.  O sea, como correlacionar un sistema completamente mecanizado estandarizado para los libros a el sistema de capitulos y versiculos.

Yo no se, pero el campo se ve altamente prometedor.

Finalmente, sigo recogiendo y descubriendo cosas en mi casa.  Tropece anoche con el primer issue de Acme Novelty Library por Chris Ware.  Cuando lo compre hace a/nos atras no estudie el nivel de complejidad y de informacion de su historia.  Ahora tengo rato para releer algunas de estas joyas.
http://en.wikipedia.org/wiki/Acme_Novelty_Library

Y sigo mi camino antes que sea mas tarde.
Related Posts Plugin for WordPress, Blogger...