FOR EMPLOYED STATISTIANS: What are the most important skills for beginners?

I don’t know how to make up for not having a stricly statistical degree in a job interview. So what should I highlight? What can I do?

THANK you! I’ll get my bachelor degree in sociology, which includes statistic. I worked 2 months in a apprenticeship with databanks. I worked 4 months in another apprenticeship in a big company on a 40 page report (including presentation). I can just a little programming (javascript) and know R Basics. I speak english, german and a little russian and mandarin chinese.

submitted by /u/mxdata
[link] [comments]

[Kaggle] Youtube Trending Videos – Detailed ANALYSIS (EDA)

Hi all

on a udacity project , I completed an EDA(Exploratory Data Analysis) on Youtube Trending Videos

Main findings:

I found some interesting facts about Youtube trending videos; these are:-

84% or more trending videos are using one of its tag on the video title for at least once.

Other than 604 trending videos,all trending videos are appeared in the trending list for more than 1 once.

Maximum number of Youtube videos are listed on trending, within 0 to 14 days of the video publishing date.

More users engaged in conversation when they were disliking a trending video rather than liking a trending video.

If difference between first trending date & publish date is less than 4 days,then there is a big chance,that video would not be re-trended for more than 3 times.

There is a impact on Youtube trending videos views count over tag_appeared_in_title or not.

Trending videos those have listed for more than 5 times got the highest number of views.

Videos belongs to categories where number of subscriber is/are most ;those videos are using at least one of its tag on the trending video title.

Surprise! findings:

Many of Youube trending videos get listed on trending list for more than 1 time(or day), but they did not get higher number of traffics.

Another point I already discussed,many of the trending videos have lower number of subscriber(some of them have 0) & yet they managed to get greater number of viewers than top subscriber channels present in the Youtube.

Also I saw there are many trending videos managed to get higher number of views counts,but they have very few likes(many of them have 0).


Don’t forget to visit below Kaggple Kernel

URL:

https://www.kaggle.com/sgonkaggle/exploring-youtube-trending-videos-insights-eda

submitted by /u/SGonRedd
[link] [comments]

an eGuide; The right rewards drive ROI – How to optimise your reward strategy for success

Think of it as a handy guide to understanding and implementing the right rewards, at the right time, and for the right people.

https://koi-3QND239JLW.marketingautomation.services/net/m?md=Lie4VHIUQGbNwSwhYXfiH5lYA9hW82mG

submitted by /u/emzjane
[link] [comments]

Sample Size for Customer Survey

My boss is setting up a survey of 300 locations and of around 50,000 of our subscribers. The survey will contain 6 questions about customer satisfaction.

Right now, he wants to do 30 locations (10% of the network) and 20 customers per location. Now, intuitively it seems to me like a decent spread but the decision on this entirely lacked any methodology and they just kinda followed their gut.

Firstly, I’d like to ask… is this a decent/reasonable spread? Also, can anyone explain a bit about sampling methodology or point in a direction about where to find this information?

submitted by /u/poli_trial
[link] [comments]

Images of royals?

Hi, everyone. I’m starting a blog after all this royal wedding type on the happenings of the British royal family. I anticipate writing on other royal families and individuals from time to time, as well. I’m quickly finding that writing isn’t my problem, but finding quality images of the royals that are free to use — as I imagine it would be hard for most blog writers are caught in the same Catch 22!

Any tips on how to find images of the royal wedding, for example, that are free to use? How can I even run a blog on royalty without having images of them?

Thanks for any tips or advice you may have!

submitted by /u/thomas_basic
[link] [comments]

Art as a Foreign Language

Some additional notes and more content on DSCyprus.com

I’ve always been interested in art. It is amazing to me how many feelings and ideas people can express and how many forms, shapes, and colors it can take. There is no one specific way that is correct for self-expression. To me, good art is one that makes me feel something, the stronger the better. Art can evoke in me any mixture of feelings that I can feel. It can throw me back and remind me of times in my life that I have not thought of in a long while. It can express ideas and sometimes even opinions without uttering a single word.

I think that what most captivates me about art is the fact that it conveys a feeling of connection. I always felt that our skills of speech and communication are somewhat limited. They have evolved over the last few tens of thousands of years to serve certain purposes and I think we often forget that they are not necessarily perfect. They may help us achieve complex goals and build relationships, but I can’t help but feel that we may never truly project what is going on inside our heads to our peers. Some things in me feel too big to express with words, and art seems to help close that gap.

Music can sometimes feel like it expresses what I feel inside like nothing else can. I love music. When I was younger, I used to spend almost all of my time learning music theory, writing and refining my own music. For hours a day, I would study the guitar – I wanted to not have to think about the music I was playing. I wanted to trust my fingers to know what to do on their own, so I could use the most of my mental capacity to concentrate on what I wanted to express. I was never overly talented or anything, but I got a small glimpse into this artistic experience.

I used to try every variation and mixture of chords, scales, and modes that I could think of. Sometimes, a single modulation or chord progression would have such a distinct feeling that I could easily recognize it and implement it in my own music. After a while, it became easier to discern the feelings of less distinct variations. Exploring different variations felt like finding new colors on a painter’s palette. ‘Unlocking’ these colors made more specific feelings available to me to write with. The best example of music that is full of color is Claude Debussy’s music. His music sounds like what a colorful painting would sound if you could convert it to music.

I only took a few steps into the world of music, and already I felt like I could communicate some feelings that I simply cannot express with words. I got the impression that if I could try and learn all the musical scales and modes, then I would unlock all the colors, all the tastes, all the feelings and I would be able to show them to the world. I could try and bridge the gap that is between you and me in a way I can’t with words.

The fact that art is so personal and subjective makes it even more beautiful. You don’t have to explain why you love a painting. You don’t have to feel guilty about having or not having a connection to a certain sonata, concerto or symphony. You are not obliged to make excuses for what you feel. In a way, we are all curators for our own art galleries. We find and collect pieces of art that we feel a connection to. We create an assortment of works that collectively express our view of the world. We share pieces of it with those we love, to try and let them share our feelings. We hope that they would feel what we feel. We hope that for a moment we could connect and communicate in a way we may not be able to with words.

Now, I couldn’t write a whole article about art without seeing what science has to say about it. Let’s start with the way that we process art. Experts agree that when we view art – a certain painting, for example, a mixture of both emotional and analytical factors are used to assess it. First, we evaluate the painting instinctively and automatically. We get a feel of the painting, we unconsciously decide if we feel positively or negatively about it. This is supposedly a part of our ever-alert, unconscious defense mechanism – trying to assess threats in our surroundings. Then, we consciously analyze what we see using any context we have about it. This whole process can take seconds. Many studies point to the fact that both emotional and analytical processes affect each other and are intertwined in a way.

Usually, the first impression you get, the result of the emotional processing, acts as the basis for the analytical processing. Your first emotional reaction may be either positive or negative, and your analytical review will aim to support your emotional conclusions. If, for some reason, your emotional impression is a negative one, your analytical part will work hard to find reasons why you don’t like it. But sometimes it can take another step – you may have a specific emotional opinion, but after some analytical processing, your emotions may change to a point where you sometimes can’t recreate your first emotional response anymore.

When you get more familiar with a certain type of art, your emotional ‘barrier’ recognizes them and more readily knows that there is no threat. It lets them pass quicker and you let your analytical processing take a bigger part. The most relatable example, I find, is listening to music. I believe anyone can relate.

When I’m listening to a genre that is new to me, I feel like I’m listening with a fresh ear and a blank mind. I don’t know what to expect or what to look for, and so I’m relying heavily on my emotional processing stage. In those first few listens my emotional response is the strongest, and I feel connected to the music. After getting to know the genre a little better, I start to recognize recurring aspects in it. I find myself comparing songs, albums, and artists based on technical properties and style. This is the analytical processing stage settling in. Eventually, listening to new songs in the genre becomes a very different experience. I find that my analytical processing stage is active almost from the start – I am able to point out all the technical aspects of a song and compare them with others in the genre. By then I feel more detached as if my emotional processing stage has diminished.

In a paper titled ‘What makes an art expert? Emotion and evaluation in art appreciation’ by Helmut Leder, et al., the researchers asked if there is a difference in the processing of paintings between three groups of varying art expertise. They have shown that in all three groups there was a similar distinction between positive and negative emotions inferred from similar artworks, but that the emotional response was softened with higher levels of expertise. In short, they show that with higher levels of expertise, the emotional processing stage is relatively silenced, while the analytical processing stage is taking a larger role. Experts are more detached than lay people when viewing art.

Other studies have shown that when asked to sort information of a certain field, experts in the field do it somewhat differently than non-experts. Give a bunch of pictures of trees to a regular person and a dendrologist and ask them to sort them into groups. Let them keep dividing the pictures to sub-groups for as many times as they can. Non-experts may have some prior knowledge in the field, but most will only have the evident visual appearance to sort by. Non-experts may group the pictures by color of leaves first, and then sub-group into tall or short trees and so on. Experts, on the other hand, will probably have knowledge that isn’t visually available in the pictures. Along with the visual aspects, they may also sort by natural habitat, taxonomic relation or maybe even known symbionts. Experts usually have more levels of sub-groupings for pictures in their fields.

These sorting studies apply to art, as well. Ask non-experts and experts to sort pictures and you will see similar patterns. Non-experts might group the pictures based on color, general atmosphere or prominent objects. Experts might group the pictures based on style, technique or context, as well. The difference is that non-experts base their sorting on categories that are more shallow and visually obvious than experts.

After all the reading and planning that was necessary to write this article, I came to believe that art is just a foreign language. A painting is like a storyteller that tells a story in his own language. If you don’t speak the language, you won’t understand the meaning of the words, but you may still enjoy the sound and intonation of the language. You won’t know what the story is about, but you may infer if it’s a sad or a happy story. If you do speak the language, you may still appreciate the sound of the language, but you may also try and interpret the moral of the story. You will have more information to interpret the story by.

Often, I hear people make the argument that art is completely free for interpretation, and that expertise in art is a made up concept. While I think that everyone should enjoy their perception of art in any way they might like to, I don’t agree with that argument. Using the metaphor from the last paragraph, I think that people who don’t understand the language think that the language is made up. They might decide that it’s all gibberish, that the words don’t have any meaning and any interpretation is acceptable. These people have a hard time trusting someone else’s interpretations of different kinds of art. These people often make the argument that their interpretation is as good as anybody’s. I think that there’s an important difference between not speaking the language and knowing that you don’t speak the language. Your interpretation and perception of art are your own and that’s important. But knowing that there might be more behind art that you don’t understand may help you appreciate and enjoy it even more.

submitted by /u/DSCyprus
[link] [comments]

How to impute missing data using a predictive model?

I recently attended a talk about imputing missing data using machine learning and during the Q&A a random audience member commented that when using machine learning (or any predictive model) for imputation, we should use the resulting probability distribution to impute rather than the highest prediction probability.

From what I understand, the commenter was saying if the model says there is a 60% chance it is “A” vs “B.” Rather than assigning the missing value “A”, you should flip a weighted coin (60%/40%) and impute the outcome that way.

Can anyone explain the reasoning here? Wouldn’t it make sense to impute with the best prediction?

submitted by /u/Adamworks
[link] [comments]

Statistical test for comparing populations means based on a big sample and a small one

I have some sets of data and I would like to compare their means.

For the moment I just calculated their means and compared them but I think that viewing each set as a sample of a bigger population and using a statistical test to compare their mean would be more appropriate.

I would like to hear some opinions regarding this approach.

Besides that, I am not sure what statistical test to use. I can’t say that these data sets follow a normal distribution. The data is continuous and some sets have a few hundred items but some have less than 10.

Could you please recommend a statistical test for comparing the mean of two samples for which one is sufficiently large (more than 30 items) but the other one has less than 10?

I was thinking about using a T test but since I can’t say that the populations follow normal distributions and the samples aren’t big enough in all cases, I’m not sure if that’s appropriate.

submitted by /u/IceVortex
[link] [comments]